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s factor.  The  other  two  Piagetian  tasks 
were  the  best  predictors  of  performance  for  each  other.  In 
addition,  the  most  important  ability  necessary  for  success- 
ful performance  on  the  Piagetian  tasks  was  the  isolation  and 
control  of  variables.  It  was  concluded  that  separate  abil- 
ities may  underlie  performance  on  the  two  types  of  tasks. 

This  conclusion  was  supported  by  the  results  of  Experi- 
ment 2,  which  employed  a more  sensitive  test  of  the  proposi- 
tional logic  basis  of  solving  Piagetian  tasks.  The  bending 
rods  and  pendulum  problems  from  Experiment  1 were  modified 
by  formulating  specific  questions  based  on  the  isolation  and 
control  of  variables.  Hypothetical  results  and  hypotheses 
based  on  propositional  logic  rules  were  also  presented  for 
evaluation  by  subjects.  Most  subjects  recognized  confounded 
results  and  could  isolate  and  test  variables  correctly.  Ad- 
ditionally, their  responses  conformed  to  simple  logical 
rules  when  evaluating  most  of  the  presented  results  and  hy- 

the  questions  based  on  propositional  logic  and  on  the  isola- 
tion of  variables  was  inconsistent.  The  results  of  both  ex- 
periments are  discussed  in  terms  of  the  use  of  "schemes11 
rather  than  propositional  logic  as  the  basis  for  successful 


performance  on  Piagetian  tasks. 


CHAPTER  1 

PIAGET'S  THEORY  OP  FORMAL  OPERATIONS 

Since  the  publication  of  Inhelder  and  Piaget's  1958 
book  entitled  The  Growth  of  Logical  Thinking  from  Childhood 
to  Adolescence,  formal  operational  abilities  have  been  the 
subject  of  much  discussion , controversy  and  empirical  inves- 
tigation. This  area  of  Piaget's  theory  is  probably  the 
least  understood,  however,  because  there  is  proportionally 
less  inquiry  into  this  last  stage  of  cognitive  development 
than  into  any  other  Piagetian  stage.  This  chapter  will  be- 
gin with  a description  of  formal  operations  as  it  was  orig- 
inally defined  by  Piaget.  Empirical  evidence  for  Piaget's 
theory  will  then  be  presented,  and  lastly,  the  current  state 
of  formal  operations  theory  and  research  will  be  discussed. 

Original  Formulation  of  Formal  Operations 

Piaget's  theory  of  formal  operations  is  most  thoroughly 
defined  in  Inhelder  and  Piaget  (1958) . Several  excellent 
secondary  sources  serve  to  clarify  and  organize  the  material 
presented  by  Piaget,  including  books  by  Brainerd  (1978) , Fla 
veil  (1963) , and  Ginsburg  and  Opper  (1969) . The  following 
discussion  draws  heavily  on  the  information  presented  in 
these  three  books  and  in  Inhelder  and  Piaget  (1958) . 


Piaget's  theory  of  cognitive  development  is  character- 


ized by  the  postulation  of  four  stages — the  sensorimotor 
stage , preoperetions , concrete  operations , and  formal  opera- 
tions. As  in  accordance  with  any  stage  theory,  the  child 
passes  through  these  stages  in  this  invariant  order.  The 
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the  child  possesses  reversible  operations  which,  among  other 
things,  enable  him  or  her  to  focus  on  transformations  rather 
than  states,  become  less  egocentric,  and  decenter  his  or  her 
thought.  This  ability  is  shown  clearly  in  several  of  Pia- 
get's demonstrations,  especially  those  concerning  conserva- 
tion. For  example,  the  child  now  realizes  that  there  is  the 
same  amount  of  water  in  a short  wide  beaker  as  in  a tall, 
thin  beaker  when  the  water  is  poured  from  one  to  the  other. 
A child  in  the  preoperational  stage  will  state  that  there  is 
more  water  in  the  tall,  thin  beaker,  apparently  "captured" 
by  the  saliency  of  water  level. 

There  are  several  important  limitations  of  concrete  op- 
erations. Firstly,  the  reversible  operations  of  negation 
(undoing)  and  reciprocity  (compensation)  that  allow  the 
child  to  achieve  the  abovementioned  concrete  operational 


ot  coordi- 
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abilities  exist  as  cognitive  operations  b 
nated  into  a single,  integrated  system, 
not  correctly  solve  problems  that  require  the  use  of  both  of 
these  operators.  These  operators  are  described  by  Piaget  in 
terms  of  logical  groupings.  These  groupings  serve  as  a mod- 
el for  the  chi Id ' s cognitive  organization,  and  the  integra- 
tion of  these  groupings  occurs  in  formal  operations. 

A second  limitation  of  concrete  operations  is  that  the 
organizing  activity  of  these  operations  is  focused  on  con- 
crete objects  and  events  in  the  immediate  present.  In  other 
words,  reality,  rather  than  the  potential,  is  the  starting 
point  for  cognitive  activity.  Limited  inferences  can  be 
made,  such  as  linear  transitive  inferences  or  class  inclu- 
sion inferences,  but  only  if  a concrete  referent  exists. 

This  link  to  reality  leads  to  a phenomenon  known  as  horizon- 
tal decalage,  in  which  conservation  does  not  become  evident 
for  all  types  of  matter  at  the  same  time.  In  fact,  years 
intervene  between  the  attainment  of  conservation  of  the  ear-’ 
liest  and  latest  materials  (usually  liquid  and  volume,  re- 
spectively) . This  decalage  occurs  precisely  “because  his 
cognitive  instruments  are  insufficiently  'formal,'  insuffi- 
ciently detached  and  dissociated  from  the  subject  matter  they 
bear  upon,  to  permit  a content-free,  once-for-all  s 
ing"  (Flavell,  1963,  p.  204). 

The  transition  to  formal  operations  o 
during  adolescence.  The  major  general  characteristic  o 


this  stage  is  that  reality  is  no  longer  the  starting  point 
for  a problem.  Rather,  reality  becomes  just  one  special 
case  of  all  possibilities.  Now,  instead  of  trial-and-error 
or  random  experimentation,  the  formal  operational  adolescent 
solves  a problem  by  trying  to  imagine  all  of  the  possible  re- 
lationships present  in  the  data  and  then  attempts  to  discover 
which  of  the  possible  relations  do  exist.  This  discovery 
takes  place  through  a combination  of  logical  analyses  and 
experimentation.  Since  the  adolescent  has  the  potential  to 
imagine  all  that  could  occur,  he  or  she  has  a much  greater 
chance  of  discovering  all  that  does  occur.  The  adolescent 
is  no  longer  limited  by  the  specific  situation,  which  is  a 
fundamental  reorientation  toward  approaching  cognitive  prob- 
lems over  the  concrete  operational  child. 

Several  other  characteristics  of  formal  thought  are  a 
result  of  this  reorientation.  Thought  becomes  primarily  hy- 
pothetico-deductive . To  attempt  to  discover  the  real  among 
the  possible,  one  must  first  consider  a set  of  possible  hy- 
potheses to  be  tested.  Those  which  are  confirmed  by  data 
are  then  classified  as  reality.  This  type  of  scientific  rea- 
soning is  possible  because  the  adolescent  is  now  able  to  sys- 
tematically isolate  and  combine  variables  into  all  possible 
combinations,  as  well  as  correctly  interpret  the  results  of 
these  empirical  tests. 

In  addition,  formal  operational  thought  is  no  longer 
content-bound,  it  is  propositional.  Concrete  operational 


thinking  is  defined  as  a first-order  operation — the  child  or- 
ganizes objects  and  events  themselves  by  classification, 
seriation,  and  so  on.  Formal  operational  thinking  consists 
of  second-order  operations.  The  adolescent  takes  the  results 
of  the  first-order  operations,  formulates  propositions  from 
them,  and  then  operates  further  on  these  propositions  by 
forming  logical  connections  between  them. 

Generally,  formal  operations  can  be  characterized  by  an 
orientation  toward  problem  solving  by  the  use  of  isolation 
and  control  of  variables  and  combinatorial  analyses  to  organ- 
ize data.  In  addition,  there  is  an  orientation  towards  the 
hypothetical  and  towards  logical  justification  and  proof. 

Piaget  proposed  that  these  general  characteristics  of 
formal  operations  are  the  result  of  an  underlying  logico- 
mathematical  core  system.  This  core  system  consists  of  an 
integrated  lattice-group  structure,  namely,  the  16  binary 
propositional  operations.  These  16  operations  are  given  in 
Table  1.  The  operations  are  called  "binary"  because  they 
consist  of  two  propositions,  p and  q,  which  can  be  either 
true  (p,q)  or  false  (p,q) . Thus,  there  are  four  possibil- 
ities— (p,  p,  q,  and  q) , which  are  combined  into  four  ele- 


mentary propositions:  pq,  pq,  pq,  and  pq.  There  are  16 

unique  patterns  of  truth  and  falsity  for  these  four  proposi- 
tions. This  is  demonstrated  in  Table  1.  Each  pattern  is 
named  and  consists  of  a propositional  logic  rule.  The  under- 
standing and  use  of  these  rules  has  been  investigated,  and 


The  16  Binary  Propositional  Logic  Rules 


Elementary  Propositions" 


Affirmation 
Inclusive  disjunction 
Reverse  implication 
Affirmation  of  p 
Implication 
Affirmation  of  q 
Biconditional 
Conjunction 
Nonconjunction 
Exclusive  disjunction 

Nonimpl ica  tion 
Denial  of  p 

Nonreverse  implication 
Conjunctive  negation 
Negation 


aThese  rule  names  were  derived  from  Brainerd  (1978)  and 
Staudenmayer  (1975) . 


component  proposition  represents 


will  be  discussed  in  Chapter  3.  For  Piaget,  each  rule  rep- 
resents an  operation  and  is  one  of  the  elements  of  the  full 
integrated  lattice  structure.  Conjunctions  are  related  by 
"and"  (•)  and  disjunctions  are  related  by  "or"  (V). 

This  core  system  develops  from  the  groupings  that  char- 
acterise concrete  operational  thinking.  The  groupings  be- 
come integrated  into  a whole  structure  as  a result  of  in- 
creasing disequilibrium  because  of  the  inability  to  success- 
fully deal  with  problems  of  increasing  complexity. 

Piaget  provides  demonstrations  of  the  use  of  the  16  bi- 
nary propositional  operations  in  formal  operations  through- 
out Inhelder  and  Piaget  (1958) . Fifteen  different  problems 
involving  different  types  of  experimental  apparatus  are  pre- 
sented to  subjects  to  illustrate  the  differences  between  con 
Crete  and  formal  operational  approaches  to  solving  each  prob- 
lem. Not  only  are  the  general  characteristics  of  both  types 
of  thinking  illustrated,  but  Piaget  interprets  the  formal  op 
erational  behavior  in  terms  of  the  16  binary  propositional 
operations.  One  example,  discussed  by  Flavell  (1963),  con- 
cerns the  combination  of  colorless  chemicals  task.  In  this 
task,  subjects  are  presented  with  supplies  of  four  percep- 
tually identical  chemicals  (colorless  and  odorless) , an . in- 
dicator chemical  (g) , and  supplies  of  test  tubes.  The  ex- 
perimenter shows  the  subject  two  beakers  which  each  contain 
one  or  more  of  the  four  chemicals,  and  adds  g to  both.  One 


The  subject's  task  is  to  find  out  which  chemical  or  combina- 
tion of  chemicals  turns  yellow  when  g is  added. 

First,  Piaget  assumes  that  p represents  one  of  the  as- 
pects of  the  problem  and  q stands  for  another.  For  example, 
in  this  problem  p could  represent  the  presence  of  a yellow 
color,  p its  absence,  q the  presence  of  one  of  the  chemicals 
(e.g.,  chemical  A),  and  q its  absence.  As  the  adolescent 
makes  the  combinations  of  chemicals,  he  or  she  may  notice 
that  yellow  does  appear  when  chemical  A is  present  (the  pq 
case  exists) . However,  rather  than  immediately  deciding  that 
chemical  A causes  the  yellow  color,  the  adolescent  is  aware 
that  this  reaction  is  only  one  of  a number  of  possibilities 
and  that  all  possible  combinations  must  still  be  tested. 

Only  when  the  entire  set  of  combinations  in  which  a yellow 
color  appears  or  does  not  appear  is  known,  will  the  signif- 
icance of  chemical  A be  known.  If  pq,  pq  and  pq  also  exist, 
the  adolescent  will  conclude  that  chemical  A is  irrelevant  to 
the  yellow  color  (Rule  SI  in  Table  1) . However,  if  chemical 
A does  cause  the  yellow  color,  pq,  pq  and  pq  will  exist. 

A further  assertion  of  Piaget  concerning  the  underlying 
core  structure  of  thought  in  formal  operations  is  that  the 
elements  of  the  lattice  are  integrated  by  the  four  operations 
of  Identity  (I) , Negation  (N) , Reciprocal  (R) , and  Correla- 
tive (c)  (the  INRC  group) . These  operations  allow  a given 
operation  to  be  transformed  into  a different  operation.  I, 
the  identity  operation,  changes  nothing  in  the  proposition 


on  which  it  is  performed.  N changes  everything  in  the  prop- 
osition on  which  it  is  performed--positives  become  negatives, 
and  all  conjunctions  become  disjunctions  and  vice  versa.  R 
changes  positives  to  negatives  and  vice  versa,  but  leaves 
conjunctions  and  disjunctions  unchanged.  C changes  conjunc- 
tions to  disjunctions  and  vice  versa,  but  leaves  positives 
and  negatives  unchanged.  Each  operation  in  the  lattice 
structure  is  related  to  other  operations  as  its  I,  N,  R,  or 
C operation.  Bart  (1971)  and  Brainerd  (1978)  provide  tables 
which  show  the  specific  relationships  between  the  operations. 
These  relationships  between  the  operations  are  what  allow 
the  adolescent  to  understand  reversibility  and  to  form  hy- 
potheses based  on  the  results  of  all  possible  combinations 
of  variables. 

The  INRC  group  can  refer  to  both  physical  actions  and 
logical  operations.  As  mentioned  before,  Piaget  interprets  • 
physical  actions  in  terms  of  propositions  and  logical  opera- 
tions to  link  them  to  the  core  structure  consisting  of  the 
16  binary  propositions.  Objections  to  this  use  of  proposi- 
tional logic,  along  with  other  objections  to  Piaget's  the- 
ory, will  be  discussed  in  Chapter  2. 

Piaget's  methodology,  as  described  in  Znhelder  and  Pia- 
get (1958) , will  now  be  discussed  because  of  relevance  to  lat- 
er experiments.  Piaget  investigated  formal  operational  thought 
by  means  of  presenting  subjects  with  a situation,  scientific 


in  nature,  and  asking  them  t 
a modified-clinical  method  i 


discover  the  relevant  vari- 
Df  interest.  His  method  was 
which  open-ended  instructions 


were  given  at  the  beginning  of  the  session,  and  the  actions 

or  explanations  would  be  necessary.  Each  experimental  set- 
ting was  designed  to  test  scientific  reasoning,  and  some 
problems  focused  on  specific  aspects  of  formal  operations 
such  as  isolation  of  variables  or  exclusion  of  variables. 

The  apparatus  was  often  quite  elaborate,  as  in  the  com- 
bination of  colorless  chemicals  task,  which  involved  five 
chemicals  (water,  diluted  sulphuric  acid,  oxygenated  water,  sodium 
thiosulphate,  and  potassium  iodide)  plus  test  tubes  and 
beakers.  Some  of  the  other  tasks  are  as  follows: 

The  Oscillation  of  a Pendulum — subjects  are  presented  with 

lengths  of  string,  weights,  and  an  overhanging  bar;  and 
the  problem  is  to  find  the  factor  that  determines  the 
frequency  of  oscillation. 

The  Bending  Rods  Problem — the  subjects  is  presented  with  a 
set  of  rods  differing  in  composition,  length,  thick- 
ness, and  cross-sectional  form  and  a large  basin  of 
water.  The  rods  can  be  attached  to  the  edge  of  the 
basin,  and  three  different  weights  can  be  screwed  onto 
the  end  of  the  rods . The  subject  is  asked  to  deter- 


is  flexible  enough 
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The  Equality  of  Anglos  of  Incidence  and  Reflection — the  ap- 
paratus resembles  a billiard  game.  Balls  are  launched 
with  a spring  device  that  can  be  pivoted  around  a fixed 
point.  The  subject  is  asked  to  aim  at  targets  placed 
at  different  points  by  shooting  the  ball  against  a pro- 
jection wall  so  that  it  rebounds  to  the  interior  of  the 
apparatus . 

The  Law  of  Floating  Bodies — the  subject  is  asked  to  classify 
objects  as  to  whether  or  not  they  will  float  on  water 
and  to  explain  their  answers.  Then,  he  or  she  actually 
experiments  with  buckets  of  water  and  objects  including 
pieces  of  wood,  wire,  a metal  weight,  metal  needles,  a 
pebble,  a plank,  boats,  ducks,  a piece  of  candle, 
matches,  cork,  paper,  and  so  on. 

Other  experimental  situations  include  predicting  displacement 
of  water  and  other  liquids  in  communicating  vessels,  deter-  ■ 
mining  why  a metal  bar  attached  to  a rotating  disk  stops 
with  the  bar  pointing  to  one  pair  of  boxes  instead  of  any 
other  boxes  placed  around  the  disk,  predicting  how  far  balls 
of  varying  sizes  will  travel  when  launched  by  a spring  de- 
vice, predicting  in  what  order  different  sized  balls  in  vari- 
ous positions  will  leave  a rotating  disk  when  the  speed  of 
rotation  is  increased,  and  producing  two  shadows  of  the  same 
size  on  a screen  using  different  sized  rings  in  front  of  a 


Empirical  Evidence 


From  the  earliest  reviews  of  and  replications  o 
work  in  Inhelder  and  Piaget  (1958)  there  have  b 
questions  concerning  Piaget's  interpretation  of  his  data, 
the  use  of  propositional  logic  as  his  model  for  thought,  the 
universality  of  formal  operations,  and  the  extent  to  which 
formal  operations  is  context-free.  The  most  serious  crit- 

logic  will  be  discussed  in  Chapter  2.  However,  many  research- 
ers accept  formal  operations  as  a valid  psychological  con- 
struct, and  their  work  has  served  to  refine  and  expand  the 
theory.  A review  of  representative  research  in  various  areas 
of  formal  operations  follows. 

Lovell  (1961)  was  one  of  the  first  researchers  to  at- 
tempt to  replicate  the  experiments  in  Inhelder  and  Piaget 
(1958) . Using  10  of  the  tasks  and  200  subjects,  Lovell  in- 
terpreted his  data  as  supportive  of  Piaget  in  stages  of  de- 
velopment, the  overall  level  of  performance  on  all  tasks, 

protocols.  However,  there  were  enough  discrepancies  in  the 
amount  of  prompting  required,  the  order  of  behaviors  evi- 
denced, and  other  characteristics  that  Lovell  concluded  that 
Inhelder  and  Piaget  "have  somewhat  forced  the  development  of 
the  child's  thinking  into  a theoretical  framework"  (Lovell, 
1961,  p.  151). 


Martorano  (1977)  also  administered  10  traditional  Pia- 
getian  tasks  to  20  female  subjects  each  in  grades  6,  8,  10 , 
and  12.  Results  revealed  that  as  grade  increased,  mean 
scores  on  the  10  tasks  increased  as  well,  with  evidence  that 
formal  thinking  begins  to  emerge  between  12  and  15  years  of 
age.  However,  subjects  even  in  the  oldest  age  group  did  not 
perform  consistently  at  the  formal  operational  level  across 
all  tasks.  Post  hoc  analyses  revealed  significant  differ- 
ences between  tasks  in  level  of  performance.  The  order  of 
difficulty  of  the  tasks,  from  easiest  to  hardest,  was  col- 
ored tokens,  correlations,  combination  of  colorless  chem- 
icals, permutations,  pendulum,  bending  rods,  shadows,  bal- 
ance, communicating  vessels,  and  hydraulic  press,  other  re- 
searchers have  avoided  the  effects  of  the  task  differences 
by  testing  primarily  for  only  one  of  the  aspects  of  formal 
operational  ability,  such  as  isolation  of  variables  (e.g., 
Kuhn  £ Angelev,  1976;  Kuhn  & Brannock,  1977) , combinatorial 
reasoning  (Barratt,  1975),  and  proportional  reasoning,  (e.g. 
Capon  £ Kuhn,  1979). 


It  soon  became  evident  that  the  attainment  of  formal 
operations  was  far  from  universal.  A sample  of  estimates 
of  the  number  of  subjects  in  high  school  and  in  college  op- 
erating in  a fully  formal  operational  manner  range  from  20* 
to  25*  (e.g.,  McKinnon  £ Renner,  1971;  Schwebel,  1975;  Tom- 
linson-Keasey,  1972) . Higher  estimates  occur  for  subjects 
operating  at  a lower  formal  operational  stage,  usually 


around  50*  (e.g.,  Dam 
linson-Keasey , 1972). 
for  sex  differences  ir 


S Day,  1977;  Hartorano,  1977;  Tom- 
i addition,  there  is  some  evidence 


favoring  males  (e.g.,  Douglas  s Wong,  1977;  Keating  & 
Schaefer,  1975;  Schwebel,  1975).  Piaget  (1972)  clarified 
his  theory  to  take  into  account  specific  knowledge,  profes- 
sions, and  interests  which  may  have  an  effect  on  the  expres- 
sion of  formal  operations.  He  argued  that  this  was  not  con- 
tradictory to  his  earlier  assertion  that  formal  thinking  is 
independent  of  content  because  ".  . . it  is  one  thing  to  dis- 
sociate the  form  from  the  content  in  a field  which  is  of  in- 
terest to  the  subject  and  within  which  he  can  apply  his  cu- 
riosity and  initiative,  and  it  is  another  to  be  able  to  gen- 
eralize this  same  spontaneity  of  research  and  comprehension 
to  a field  foreign  to  the  subject's  career  and  interests” 
(Piaget,  1972,  p.  10).  Piaget  (1972),  then,  argues  that  for- 
mal operations  are  free  from  concrete  content  but  only  when 
the  situation  involves  vital  interests  or  knowledge.  This 
may  explain  both  the  scarcity  of  formal  operational  behavior 
using  the  traditional  science-based  tasks  and  the  observed 
sex  differences,  because  a minority  of  students  may  be  in- 
terested in  science,  especially  female  students. 

Another  explanation  for  the  lack  of  formal  operational 
performance  for  many  subjects  is  the  method  of  assessment 
used.  Traditional  formal  operational  tasks  use  open-ended 
instructions,  and  while  this  may  allow  for  a wider  range  of 
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abilities  to  be  expressed,  it  may  not  be  clear  to  some  sub- 
jects what  the  optimal  procedure  for  successful  performance 
may  be.  Danner  and  Day  (1977)  tested  this  hypothesis  by 
providing  a series  of  prompts  (from  less  to  more  explicit) 
until  the  subject  made  unconfounded  tests  of  all  variables 
or  these  tests  were  demonstrated  (the  last  prompt) . Older 
subjects  (aged  17  years)  received  less  prompts  but  demon- 
strated improved  performance  over  tasks — 95*  of  these  sub- 
jects used  a formal  operational  strategy  for  a third  un- 
prompted task.  A control  group  who  did  not  receive  prompts 
did  not  improve,  so  practice  was  not  the  reason  for  improve- 
ment. Rather,  the.  prompts  served  to  clarify  the  tasks  for 
the  subject. 

Another  study  hypothesized  that  the  lack  of  formal  op- 
erational behavior  for  many  subjects  may  be  the  result  of  a 
variety  of  superficial  cognitive  difficulties  such  as  verbal, 
articulation  and  organizational  difficulties.  Kuhn,  Ho  and 
Adams  (1979)  gave  college  students  and  fourth  and  fifth  : 
graders  who  had  been  classified  as  non-formal  operational  re- 
peated exposure  to  problems  requiring  formal  reasoning.  For 
20  to  30  minutes  per  week  for  11  weeks,  subjects  were  asked 
questions  about  a chemical  combinations  problem  that  encour- 
aged them  to  analyze  and  attempt  to  interpret  what  was  being 
observed.  No  reinforcements,  solutions,  or  strategies  for 
obtaining  a solution  were  suggested.  The  pre-adolescents 
made  only  gradual  modest  gains,  while  most  of  the  college 


students  showed  immediate  and  substantial  formal  reason- 

In  accordance  with  Piaget's  (1972)  hypothesis,  several 
studies  have  also  investigated  the  role  of  the  content  of 
the  tasks  on  successful  formal  operational  performance,  but 
with  mixed  results.  Bart  (1972)  concluded  that  the  type  of 
premise  (absurd  or  abstruse)  in  a reasoning  task  was  less 
important  for  performance  at  various  levels  of  formal  reason- 
ing than  the  logical  structure  of  premises.  Kuhn  and  Bran- 
nock  (1977)  devised  a task  which  tests  primarily  isolation 
of  variables  in  a more  natural  setting — the  care  and  health 
of  plants.  The  same  errors  of  reasoning  present  before  the 
acquisition  of  formal  operations  described  by  Inhelder  and 
Piaget  (1958)  occurred  with  this  task,  but  performance  on 
this  task  and  a traditional  Piagetian  task  (the  pendulum 
problem)  was  not  related.  Kuhn  and  Brannock  conclude  that 
the  two  types  of  situations  pose  different  problems  for  sub- 

Capon  and  Kuhn  (1979)  tested  the  use  of  propositional 
reasoning  by  adult  female  shoppers  in  a supermarket.  The 
subjects  were  asked  to  determine  which  of  two  sixes  of  gar- 
lic powder  or  deodorant  was  the  better  buy.  Even  when  the 
ratio  of  sizes  was  simple  (2:3),  only  324  of  the  subjects 
were  able  to  use  a proportional  reasoning  strategy  to  deter- 
mine the  correct  choice.  Additionally,  Keating  and  Clark 
(1980)  found  that  performance  on  social,  interpersonal 


reasoning  tasks  (presumably  more  familiar  to  adolescents) 
was  no  better  than  on  tasks  based  in  the  physical  domain. 

Only  13%  of  the  subjects  performed  better  on  the  social 
tasks  and  52%  of  the  subjects  performed  better  on  the  physi- 
cal tasks.  However,  Sabatini  (1980)  found  that  there  were 
no  age  effects  on  formal  operational  performance  between  col- 
lege-aged students  and  older  adults.  All  of  the  differences 
observed  were  accounted  for  entirely  by  professional  special- 
ization (scientists  versus  nonscientists) . Also,  Pulos  and 
Linn  (in  press)  found  familiarity  effects  on  the  use  of  con- 
trolling variables.  Rural  adolescents  performed  better  than 
urban  adolescents  on  a task  involving  fishing,  and  urban  sub- 
jects performed  better  on  a more  scientific  task  involving 
a spring  apparatus. 

A related  question  concerns  the  relationship  between 
formal  operational  abilities  and  classroom  training.  Host 
of  the  empirical  results  appear  to  be  negative,  despite  Pia- 
get's (1972)  hypothesis  of  the  effects  of  familiarity  of  ma— ‘ 
terials  on  formal  reasoning.  Lovell  (1961)  found  no  effect 
of  classroom  training.  Lawson  and  Blake  (1976)  tested  high 
school  biology  students  on  biology-based  formal  operational 
tasks,  traditional  Piagetian  tasks  (physics-based) , and  for- 
mal operational  tasks  with  a nonscience  content,  but  found 
no  differences  in  performance  for  the  three  types  of  tasks. 
Griffiths  (1976)  observed  that  experience  in  highly  technical 
physics  classes  was  not  necessary  for  formal  operational 


development;  and  in  fact,  many  students  had  technical  vocab- 
ularies but  did  not  fully  possess  the  formal  operational 
abilities  to  isolate  and  control  variables  on  a physics 
task.  On  the  other  hand,  Pulos  and  Linn  (in  press)  and  Saba- 
tini  (1980),  as  mentioned  above,  have  found  evidence  for  the 
effects  of  experience  on  formal  operational  reasoning. 

Researchers  have  also  investigated  the  relationship  be- 
tween formal  operational  abilities  and  other  variables. 

Wyatt  and  Geis  (1978)  observed  that  the  highest- level  formal 
operational  subjects  had  a greater  amount  of  recall  and  re- 
call organization  than  did  lower-level  formal  operational  sub- 
jects on  a multitrial  free-recall  task.  Berzonsky,  Weiner 
and  Raphael  (1975)  hypothesized  that  subjects  experiencing 
an  identity  crisis,  in  which  a person  considers  what  one 
could  possibly  become  in  addition  to  what  one  is,  would  per- 
form better  on  formal  reasoning  measures  than  noncrisis  sub- 
jects. This  hypothesis  was  not  supported,  and  the  results 
were  interpreted  as  in  accordance  with  Piaget's  (1972)  hy- 
pothesis for  the  selectiveness  of  formal  operations.  Blasi 
and  Hoeffel  (1974)  also  agree  that  personality  development 
in  adolescence  takes  place  independently  of  formal  operations 
because  nonphysical  concepts  such  as  will  and  creativity  are 
a part  of  the  integration  of  concepts  of  socio-psychological 

Heimark  (1975:  Note  1)  has  argued  for  the  existence  of 
a relationship  between  formal  operations  and  field  dependence/ 


independence  both  empirically  and  theoretically,  as  has 
Pascual-Leone  (e.g.,  1970)  and  his  colleagues.  They  propose 
that  field  independent  subjects  are  able  to  abstract  out  the 
important  attributes  of  the  situation  at  hand  to  aid  them  in 


successful  performance,  especially  in  an  ambiguous  situation, 
as  traditional  formal  operational  tasks  often  are  (Neimark, 
Note  1) . Flexer  and  Roberge  (1980)  have  produced  evidence 
that  the  effects  of  field  dependence/independence  are  due 
to  an  overlap  with  IQ.  Other  studies  relevant  to  the  rela- 
tionship of  IQ  and  formal  operations  have  demonstrated  that 
measures  of  IQ  and  reasoning  abilities  tap  different  abil- 
ities (Stephens,  McLaughlin,  Miller  S Glass,  1972) , that  IQ 
is  related  to  the  speed  of  mastery  of  within-stage  skills 
(Webb,  1974) , that  high  IQ  students  have  high  levels  of  for- 
mal operational  reasoning  (Keating,  1975) , and  that  Scholas- 
tic Aptitude  Test  scores  are  related  to  formal  operational 
scores  for  females  but  not  males  (Schwebel,  1975) . 

Arlin  (1975,  1977)  has  proposed  that  a fifth  stage  of 
development  exists  beyond  formal  operations  (or  problem- 
solving) which  is  referred  to  as  problem-finding.  Her  re- 
sults indicated  that  formal  operations  were  a necessary  but 
not  sufficient  condition  for  the  existence  of  problem-find- 
ing. However,  Fakouri  (1976)  argues  that  problem  finding 
may  be  viewed  as  content  improvement  within  formal  opera- 
tions rather  than  a structural  stage,  or  selective  manifes- 
tation of  formal  operational  abilities.  In  addition. 


Cropper,  Meek  and  Ash  (1977)  found  no  relationship  between 
problem  solving  and  problem  finding. 

finally,  several  researchers  have  called  for  an  infor- 
mation-processing approach  to  Piagetian  tasks  so  that  atten- 


tional,  memory  and  strategy  demands  on  performance  on  the 
very  complex  formal  operational  tasks  cm  be  assessed.  Among 
these  neo-Piagetian  researchers  are  Case  Ce.g.,  1978),  Pas- 
cual-Leone  (e.g.,  1970),  Restaino  (1978),  Scardamalia,  (e.g. , 
1977),  Siegler  (e.g.,  1978)  and  (tollman  (e.g.,  1979). 

To  summarise,  one  unequivocal  finding  in  the  investiga- 
tion of  Piaget's  theory  of  formal  operations  is  that  the  uni- 
versality of  the  attainment  of  formal  operations  does  not  ap- 
pear to  be  as  high  as  was  expected  by  Inhelder  and  Piaget. 
Taking  this  finding  into  account,  Piaget's  results  have  been 
replicated  with  respect  to  isolation  of  variables,  proportion- 
al reasoning,  hypothesis  testing,  and  combinatorial  analysis, 
as  well  as  with  studies  employing  at  least  10  of  his  tasks. 
Conflicting  results  have  been  observed  for  many  aspects  of 
formal  operations,  such  as  the  role  of  context  and  the  rela- 
tionship of  formal  operations  to  other  variables  including 
field  dependence/independence,  classroom  training,  and  intel- 
ligence. The  effect  of  the  often-used,  open-ended  instructions 
and  lack  of  exposure  to  the  tasks  used  have  been  offered  as 
possible  reasons  for  the  failure  of  many  subjects  to  exhibit 
formal  operations  as  well. 


Conflicting  results 


tence  of  a fifth  stage  of  cognitive  development  referred  to 
as  problem-finding.  In  addition,  a call  for  task  analyses 
as  well  as  the  investigation  of  the  role  of  information  proc- 
essing abilities  in  the  expression  of  formal  operational 
abilities  for  Piaget's  tasks  has  led  to  the  formulation  of 
several  neo-Piagetian  approaches. 

The  empirical  investigation  of  the  underlying  proposi- 
tional logic  basis  of  formal  operations  is  practically  non- 
existent. It  is  not  known  if  this  is  because  researchers  as- 
sume that  this  logic  base  exists  and  does  not  need  to  be  em- 


pirically verified,  if 
and  thus  does  not  need 
searchers  simply  do  not 
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assumed  that  it  does  not  exist 
investigated,  or  that  most  re- 
to  do  research  in  this  area, 
t relationship  of  performance  on 
tasks  to  formal  operational  ability  is 
dissertation.  Hence,  the  next  chapter 
theoretical  objections  to  Piaget's  prop- 


ositional logic  system,  empirical  evidence  supporting  this 
system,  and  other  criticisms  of  Piaget's  theory.  Chapter  3 
then  discusses  the  research  on  two  propositional  logic  prob- 
lems very  similar  in  overall  problem-solving  framework  to 
Piaget's  problems  that  will  be  utilized  in  this  dissertation. 


CHAPTER  2 

CRITICISMS  OP  PIAGET’S  THEORY  OP 
FORMAL  OPERATIONS 

Criticisms  of  Piaget’s  theory  of  formal  operations  stem 
from  several  different  sources.  Much  of  the  confusion  about 
his  theory  comes  from  the  difficulty  in  reading  Inhelder  and 
Piaget  (1958) . For  example,  the  procedures  for  all  of  the 
tasks  are  never  fully  explained,  and  the  relationship  between 
behavior  and  Piaget's  interpretation  of  that  behavior  is  not 
explicit  (Keating,  1980) . The  criticisms  discussed  in  this 
chapter  concern  both  Piaget's  use  of  propositional  logic  and 
some  general  criticisms  of  the  internal  logic  of  his  theory. 

A reply  to  the  propositional  logic  criticisms  will  be  pre- 
sented, as  well. 

The  deficiencies  of  the  logic  used  by  Piaget  in  describ- 
ing formal  operations  are  discussed  by  Brainerd  (1978) , Ennis 
(1975),  Keating  (1980)  and  Parsons  (1960),  among  others.  En- 
nis (1975)  states  that  Piaget’s  logic  is  a "defective"  logic 
because  it  is  not  abstract.  Piaget's  propositions  do  not 
stand  alone  (as  abstract  propositions  do)  unless  one  assumes 
that  there  is  an  explicit  existential  quantifier  attached  to 
the  proposition.  For  example,  instead  of  the  proposition 
"if  p then  q,”  Piaget's  propositions  must  be  interpreted  as 
"There  exists  a p such  that  p is  q."  This  interpretation 


must  occur  because  Piaget  treats  the  propositions  as  sen- 
tences, and  the  variables  have  concrete  referents.  Thus, 
for  any  propositional  statement,  all  of  the  combinations 
mentioned  in  the  statement  must  exist,  and  the  existence 
of  any  unmentioned  kind  of  case  is  implicitly  denied. 

Piaget  agrees  that  this  is  the  interpretation  that 
should  be  given  to  his  logic  (Piaget,  1967;  cited  in  En- 
nis, 1975) . However,  this  conceptualization  leads  to  var- 
ious inconsistencies  as  well  as  paradoxical  requirements 
of  the  real  world,  and  Piaget  does  not  make  it  clear  how 
these  problems  should  be  resolved.  For  example,  Ennis 
(1975)  argues  that  it  is  unreasonable  to  require  the  ex- 
istence of  each  of  the  mentioned  cases  within  a rule  for 
that  rule  to  be  true.  In  the  example  discussed  earlier 
concerning  the  effects  of  chemical  A in  the  chemical  com- 
bination task,  the  pq  case  must  exist  (according  to  the 
reverse  implication  rule)  if  chemical  A does  cause  the  yel- 
low color.  Thus,  a yellow  color  must  exist  in  the  absence 
of  chemical  A if  chemical  A causes  the  yellow  color. 

An  additional  problem  concerning  the  confirmation  of 
the  truth  of  propositions  is  that  Piaget  does  not  make  it 
clear  whether  subjects  must  consider  all  examined  cases  or 
all  possible  cases,  including  the  unexamined  cases  that  are 
not  present  in  the  experimental  situation.  Sometimes  Piaget 
discusses  the  actual  existence  of  cases  (Inhelder  St  Piaget, 
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1958,  e.g.,  p.  299),  and  another  .(dree  he  requires  the  knowl- 
edge of  the  possibility  of  existence  (Inhelder  & Piaget, 


Ennis  points  out  that  Piaget  is  also  vague  when  he 
states  that  children  under  11-12  cannot  "handle  proposition- 
al logic,"  The  criteria  for  handling  propositional  logic 
are  not  clear.  Piaget  almost  certainly  does  not  refer  to 
master  of  propositional  calculus  because  even  college  stu- 
dents do  not  find  this  easy.  Moreover,  Piaget  states  that 
a person  using  formal  operations  is  mostly  unaware  of  the 
internal  logic  structures  that  he  or  she  is  using  except  for 
a feeling  of  certainty  (Inhelder  s Piaget,  1958) . On  the 
other  hand,  Piaget  probably  does  not  wish  to  state  that  chil- 
dren under  11  years  old  cannot  reason  with  any  of  the  forms 
of  propositional  logic  because  evidence  against  this  state- 
ment has  been  known  at  least  since  Burt's  early  experiments 
(Burt,  1919) . In  addition,  several  studies  demonstrate  that 
young  children  are  better  at  making  judgments  about  valid 
forms  of  arguments  than  invalid  forms,  but  the  same  differ- 
entiation holds  for  adults  and  adolescents  (e.g.,  O'Brien 
& Shapiro,  1968;  Roberge,  1970;  Shapiro  6 O’Brien,  1970). 
Thus,  Piaget's  formal  operations  theory  is  challenged  on 
two  counts — both  children  and  adolescents  have  the  ability 
to  reason  with  at  least  some  of  the  forms  of  propositional 
logic  and  both  find  it  difficult  to  reason  with  invalid 
forms,  also,  this  implies  that  the  16  binary  propositions 


are  not  operating  with  equal  ease  as  would  be  expected  if 
they  were  connected  together  in  a structured  whole,  as  Pia- 
get postulates  (Xnhelder  & Piaget,  1958) . 

These  difficulties  with  Piaget's  logic  system  and  with 
interpreting  what  Piaget  actually  means  in  his  statements 
led  Ennis  to  argue  that  Piaget's  claim  about  formal  opera- 
tional ability  appears  to  be  about  a total,  holistic  logical 
ability  and  not  the  ability  to  reason  according  to  a set  of 
principles  of  propositional  logic.  Because  of  the  ambigu- 
ities and  idiosyncracies  present  in  Piaget's  discussions  of 
formal  operations,  his  claims  are  untestable  {Ennis,  1975; 
Keating,  1980) . Piaget's  experiments,  then,  become  demon- 
strations which  he  interprets  within  his  framework,  but  the 
link  between  the  data  and  his  theory  is  obscure.  One  well 
known  example  is  the  protocol  of  GOU  which  appears  to  be  the 
only  data  which  demonstrate  a subject's  ability  to  state  all 
16  logical  combinations.  However,  when  this  protocol  was 
reanalyzed  by  logicians,  evidence  for  only  eight  of  the  16 
binary  operations  was  found  (Bynum,  Thomas  & Weitz,  1972) . 

This  example  also  demonstrates  the  difficulty  in  assess 
ment  of  formal  operations.  In  several  instances,  Piaget  re- 

pect  a person  with  formal  operations  to  be  able  to  use  the 
language  of  propositional  calculus  (Inhelder  s Piaget,  1958, 
e.g .,  p.  254).  Yet,  he  himself  uses  this  criterion  exclu- 
sively to  interpret  GOU's  protocol  (Inhelder  6 Piaget,  1958 


p.  102) . Keating  (1980)  also  discusses  problems  with  the 
choice  of  an  assessment  criterion.  Certain  tasks  that  Pia- 
get discusses,  such  as  the  combination  of  chemicals  task, 
suggest  that  the  ability  to  generate  all  possible  combina- 
tions of  the  elements  is  a mark  of  formal  operational 
thought.  However,  based  on  his  discussion  of  the  integra- 
tion of  the  logical  system  by  the  INRC  group  operators,  the 
use  of  a more  stringent  criterion  of  being  able  to  under- 
stand and  use  effectively  the  total  logical  system  would 
seem  appropriate.  For  example,  generating  all  possible  com- 
binations of  a number  of  elements  has  become  a criterion 
for  the  assessment  of  formal  operational  thought  (e.g., 
Neimark,  1975) . 


A second  problem  that  Keating  (1980)  discusses  is  the 
apparent  inability  to  disconfirm  the  theory.  Specifically, 
as  has  been  mentioned  before,  it  has  been  observed  in  many 
studies  that  formal  operations  is  not  universally  attained. 
Piaget  (1972)  argues  that  differential  familiarity  with  the 
content  area  probably  inhibits  performance,  and  that  hori- 
zontal decalage  may  also  contribute  to  a performance  failure. 
Thus,  when  the  theory  states  that  formal  operational  reason- 
ing should  be  occurring,  the  failure  of  this  ability  to  ap- 
pear is  usually  attributed  to  extraneous  task  factors.  How- 
ever, where  formal  operations  are  presumed  not  to  exist  per- 
formance failures  are  attributed  to  the  absence  of  formal 
operations. 


Another  source  of  difficulty  is  the  apparently  multiple 
usage  of  terms  in  inhelder  and  Piaget  (1958) . Bias!  and 
Hoeffel  (1974)  state  that  Piaget  uses  the  terra  reflective 
thinking  in  at  least  three  different  ways  but  never  distin- 
guishes between  these  uses.  The  most  common  interpretation 
of  reflective  thinking  is  the  use  of  an  elementary  process 
by  a more  complex  mechanism,  but  this  term  is  also  used  to 
refer  to  the  knowledge  of  an  act  of  thinking  and  to  the 
knowledge  of  the  self.  Flavell  (1963)  points  out  two  uses 
of  the  1NRC  group  that  Piaget  does  not  distinguish — a phys- 
ical INRC  group  in  which  actual  physical  transformations  oc- 
cur, and  a logical  INRC  group  in  which  transformation  of 
propositions  occur.  It  is  to  this  multiple  usage  that  En- 
nis (1975)  addresses  his  critique. 

The  argument  against  Piaget's  use  of  propositional  log- 
ic is  similar  to  a very  basic  argument  against  using  any 
type  of  formal  logic  as  a model  of  reasoning.  Osherson 
(1975)  and  Braine  (1978)  have  argued  that  standard  logic  5 
cannot  mirror  human  reasoning  because  logical  reality  does 
not  correspond  to  a psychological  reality.  Paradoxes  pres- 
ent in  logic  exist  because  certain  rules  of  logic  do  not  cor- 
respond to  our  intuitions  about  not  only  the  meaning  of  "if- 


this  argument  extends  to  include  all  forms  of  standard  logic. 

In  addition,  the  translation  of  any  logical  calculus 
into  linguistic  form  will  lead  to  a certain  amount  of 


! English  language  is  not  as  precise  as  log- 
> several  different  logical  interpretations 
Also,  Bynum,  Thomas  and 


imprecision.  T 
ical  calculus, 

Weitz  (1972)  state  that  there  are  six  propositional  logical 
rules  which  cannot  be  translated  into  the  English  language. 

Since  Piaget  does  not  distinguish  between  logical  oper- 
ations on  physical  objects  and  on  propositions,  Ennis'  crit- 
icisms of  his  use  of  logic  are  accurate  but  unimportant  to 
Piaget  from  a psychological  standpoint.  The  empirical  in- 
vestigation of  many  logic  systems  has  led  to  a reference 
to  concrete  objects  for  the  fullest  understanding  of  sub- 
jects’ usage  of  the  logic  system.  Therefore,  any  psycholog- 
ical investigation  into  a logic  system  will  involve  existen- 
tial referents  to  some  extent.  Ennis'  (1975)  criticisms  ap- 
pear to  be  addressed  to  an  inevitable  byproduct  of  the  psy- 
chological investigation  of  logic  (see  Broughton,  1981,  for 
a similar  argument) . His  criticisms  are  theoretical,  not 
empirical;  and  only  a few  empirical  studies  have  been  per- 
formed relevant  to  this  question. 

Piaget's  system  of  interpretation  of  behavior  in  terms 
of  his  logical  system  is  not  clear,  as  evidenced  by  the  re- 
analysis of  GOU's  protocol  by  Bynum,  Thomas  and  Weitz  (1972). 
The  status  of  the  underlying  cognitive  structure  as  consist- 
ing of  the  16  binary  propositional  operations,  therefore,  is 
equivocal.  Most  researchers  in  the  area  of  formal  opera- 
tions have  not  addressed  this  question.  Two  studies  designed 


to  investigate  this  specific  question  were  interpreted  as 
supportive  of  Piaget's  position,  and  are  presented  below. 

Moshman  (1977)  tested  the  knowledge  of  implication  and 
disjunction  with  colors  and  shapes.  Subjects  chose  patterns 
consistent  with  a statement  using  a six-alternative  forced 
choice  paradigm.  Task  difficulty  was  manipulated  by  negat- 
ing the  antecedent.  Disjunction  proved  to  be  easier  than 

ment  of  the  knowledge  of  these  rules.  Disjunction  knowl- 
edge begins  earlier  but  the  use  of  the  two  rules  reaches 
full  consolidation  with  respect  to  negation  at  approximately 
the  same  time.  Moshman  maintains  that  this  is  the  expected 
result  if  the  two  operations  are  part  of  a larger  structure 
d1  ensemble,  as  postulated  by  Inhelder  and  Piaget  (1958) . 

Riley  (1979)  presented  subjects  with  a list  of  16  prop- 
ositions, and  asked  them  to  choose  and  record  which  of  four 
cards  (representing  the  pq,  pq,  pq,  and  pq  cases)  satisfied 
the  conditions  in  the  proposition.  He  then  subjected  the 
results  to  a Guttman  scaling  analysis.  Results  revealed 
that  the  single-set  propositions  were  logically  prerequisite 
to  the  double-set  operations,  which  were  prerequisite  to 
the  triple-set  operations.  Riley  interpreted  these  results 
as  supportive  of  Piaget's  contention  that  the  four  elemen- 
tary propositions  form  the  basis  of  the  lattice  structure. 

Thus,  there  seems  to  be  some  evidence  for  Piaget's  hy- 


pothesis concerning 


proposed  system  of 


the  16  binary  propositional  operations,  but  the  relationship 
of  this  structure  to  behavior  is  still  unclear.  Research  in- 
vestigating performance  on  propositional  rules  themselves 
could  clarify  this  issue  although  the  goal  of  this  research 
was  not  to  test  assumptions  about  formal  operations.  A re- 
view of  two  particularly  relevant  propositional  logic  tasks, 
Wason's  selection  task  and  THOG  problem,  will  be  presented 


Chapter 


CHAPTER  3 

PROPOSITIONAL  LOGIC  TASKS 

The  understanding  of  propositional  logic  has  been  in- 
vestigated for  many  years.  The  typical  deductive  reasoning 
study  has  asked  directly  about  logical  syllogisms,  however, 
by  presenting  premises  and  requiring  subjects  to  produce  a 
conclusion,  verify  a conclusion,  or  choose  the  correct  con- 
clusion from  several  alternatives  (e.g.,  Neimark  & Slotnick, 
1970;  Paris,  1973;  Roberge,  1971;  Rips  & Marcus,  1977;  Stau- 
denmayer  & Bourne,  1977;  Wildman  & Fletcher,  1977) . In  ad- 
dition, inductive  reasoning  studies  employing  concept-learn- 
ing paradigms  have  been  based  on  propositional  rules  (e.g.. 
Bourne,  1970;  Bruner,  Goodnow  & Austin,  1956) . Because  of 

of  tasks  and  the  traditional  Piagetian  tasks,  the  results 
from  these  investigations  may  not  be  relevant  to  the  ques- 
tions posed  in  the  previous  chapter.  However,  two  problems 
devised  by  Peter  Wason  are  ideal  for  the  investigation  of 
formal  operational  abilities  because  a problem  solving  frame 
work  is  utilized  for  each  task.  The  subject  is  not  asked 
directly  about  the  rule  upon  which  the  problem  is  based,  but 
if  the  problem  is  to  be  solved  correctly,  the  answers  must 
conform  to  the  logical  structure  of  the  rule.  Hypothesis- 
testing ability  is  also  an  important  aspect  of  the  ability 


problems.  These  t 


s Selection  Task 


In  1966,  Nason  reported  a problem  which  is  based  on 
the  propositional  logic  rule  of  implication.  This  problem 
is  known  as  the  "four-card  problem"  or  the  "selection  task.” 
The  basic  task  is  as  follows.  The  subject  is  presented  with 
four  cards  showing,  for  example.  A,  D,  4 and  7,  respectively. 
The  subject  is  told  that  each  card  has  a letter  on  one  side 
and  a number  on  the  other  side.  The  following  rule  is  also 
presented — "If  there  is  a vowel  on  one  side  of  a card,  then 
there  is  an  even  number  on  the  other  side."  The  task  is  to 
select  only  those  cards  which  are  necessary  to  turn  over  to 
determine  if  the  rule  is  violated. 

Since  the  rule  is  an  implication  rule  ("if  p then  q") 
and  the  array  of  four  cards  represent  the  p,  p,  q and  q 
cases,  respectively,  the  correct  answer  is  to  turn  over  the 
p and  q cards  (A  and  7 in  the  example) . Only  the  combina- 
tion of  p and  q can  falsify  the  implication  rule  (see  Table 
1,  Rule  5)  so  the  p card  must  be  checked  to  see  if  q is  on 
the  reverse  side,  and  the  q card  must  be  checked  to  see  if 


This  task  is  extremely  difficult  for  most  subjects — 
usually  less  than  10%  of  the  subjects  product  the  correct 
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Laird  (1972)  ana  Evans 
a literature  on  this  task) . The  two  most 
at  are  observed  are  (1)  a failure  to  select 
(2)  selecting  the  g-card  instead.  Many  sub- 


jects do  select  the  p card,  either  alone  or  in  conjunction 
with  the  g card  (A  or  A and  4 in  the  example) . 

Several  explanations  for  this  pattern  of  responses 
have  been  postulated.  Wason  (1966)  suggested  two  possible 
explanations.  Firstly,  it  is  possible  that  subjects  have  a 
"defective"  truth  table  with  three  rather  than  two  truth 
values:  true,  false,  and  irrelevant.  For  an  implication 

rule,  any  case  involving  p (a  vowel)  is  potentially  informa- 
tive but  any  case  involving  p (a  consonant)  is  irrelevant. 
Even  though  there  is  evidence  for  the  use  of  this  type  of 
"defective"  truth  table  (Johnson-Laird  & Tagart,  1969) , this 
would  not  have  an  effect  on  the  relevant  cards  which  have  to* 
be  chosen  to  determine  the  truth  of  this  rule. 

The  second  hypothesis  was  that  subjects  were  conforming 
to  a verification  bias.  In  other  words,  subjects  tend  to 
confirm  rather  than  disconfirm  the  rule  by  choosing  the  cards 
that  would  conform  to  the  rule.  This  would  lead  to  the 
choice  of  the  true  instances  (p  and  q) . Wason  had  observed 
a similar  verification  bias  in  an  inductive  reasoning  prob- 
lem (Wason,  1960) . 

Evans  (1972)  suggested  that  a much  more  primitive  proc- 
ess was  taking  place  in  this  task.  He  suggested  that 
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subjects  were  under  the  influence  of  a "matching  bias"  rath- 
er than  a verification  bias,  whereby  they  would  merely  choose 
those  cards  that  were  mentioned  in  the  rule.  To  distinguish 
between  these  two  hypotheses,  Evans  and  Lynch  (1973) manipu- 
lated the  presence  of  negatives  in  all  possible  combinations 
within  the  implication  rule.  This  manipulation  separated  the 
usefulness  of  a particular  instance  as  a potential  verifier 
from  its  matching  status  as  a card  named  in  the  rule  (Evans, 
in  press) . The  results  supported  the  matching  bias  hypoth- 
esis over  the  verification  hypothesis,  and  this  result  was 
further  supported  by  Manktelow  and  Evans  (1979) . 

It  is  possible  that  the  use  of  abstract  materials  in  the 
task  inhibits  a combinatorial  analysis  strategy  because  of 
the  essentially  meaningless  nature  of  the  problem.  Perfor- 
mance on  the  task  could  possibly  be  facilitated  by  the  use 
of  thematic  materials.  In  fact,  Hason  and  Shapiro  (1971)  ob- 
served vastly  improved  performance  when  they  employed  rules 
employing  thematic  materials  such  as  "Everytime  1 go  to  Man- 
chester I travel  by  car."  In  addition,  Johnson-Laird , 
Legrenzi  and  Sonino  Legrenzi  (1972)  asked  subjects  to  imag- 
ine that  they  were  postal  workers  and  to  determine  if  rules 
such  as  "If  a letter  is  sealed,  then  it  has  a 50  lire  stamp 
on  it,"  were  violated.  In  these  studies,  performance  in- 
creased to  62.5*  correct  and  81*  correct,  respectively.  How- 
ever, attempts  to  replicate  these  results  have  been  less 
than  successful  (Brown,  Keats,  Keats  £ Seggie,  1980;  Griggs 
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& Cox,  in  press.  Experiments  1 and  2;  Manktelow  & Evans, 

1979;  Yachanin,  1980;  but  see  Bracewell  & nidi,  1974;  Pol- 
lard, 1981;  and  Van  Duyne,  1974) . 

Both  Manktelow  and  Evans  (1979)  and  Griggs  and  Cox  (in 
press)  hypothesized  that  thematic  materials  would  facilitate 
performance  only  if  they  served  in  a memory-cuing  capacity. 

In  other  words,  simply  presenting  subjects  with  thematic  ma- 
terials will  not  lead  to  correct  responding.  Only  if  the  ma- 
terials, the  rule,  and  the  falsifying  instance  are  specif- 
ically a part  of  the  subject's  past  experience  will  correct 
performance  occur.  Griggs  and  Cox  (in  press,  Experiment  3) 
tested  this  hypothesis  by  presenting  subjects  at  the  Univer- 
sity of  Florida  with  the  rule,  "If  a person  is  drinking  beer, 
then  the  person  must  be  over  19  years  of  age , " a law  in  Flor- 
ida at  the  time  of  the  study.  Performance  increased  dramat- 
ically to  about  70%,  but  correct  performance  was  not  trans-  ■ 
ferred  to  the  abstract  selection  problem  when  given  immedi- 
ately afterwards.  This  suggests  that  memory  cuing  is  the 
cause  of  improved  performance  rather  than  the  elicitation  of 
logical  processing. 

Regardless  of  the  processes  involved  in  answering  the 
selection  problem,  it  is  obvious  that  most  subjects  are  not 
using  an  appropriate  combinatorial  truth  table  analysis  to 
choose  the  cards  to  turn  over.  The  common  pattern  of  choos- 
ing the  p card  alone  or  the  p card  and  the  q card  together 


conform 


implication 


pattern  also  does  not  conform  to  a biconditional  rule,  which 
is  a common  interpretation  of  an  "if — then"  statement  (e.g., 
Moshman,  1979;  Rips  & Marcus,  1977) . The  rule  would  then  be 
interpreted  to  mean  "If  there  is  a vowel  on  one  side  of  the 
card,  then  there  is  an  even  number  on  the  other  side,  and  if 
there  is  an  even  number  on  one  side  of  the  card  there  is  a 
vowel  on  the  other  side."  If  a biconditional  interpretation 
had  been  given  to  the  rule,  all  four  cards  would  have  to  be 
turned  over.  Both  the  pq  case  and  the  pq  case  will  discon- 
firm  a biconditional  rule  (see  Table  1,  Rule  10) . Thus,  the 
p card  (A)  would  have  to  be  turned  over  to  check  for  the 
presence  of  q (7) , the  q card  (7)  would  have  to  be  turned 
over  to  check  for  the  presence  of  p (A) , the  p card  (D)  would 
have  to  be  turned  over  to  check  for  the  presence  of  q (4) , 
and  the  q card  (4)  would  have  to  be  turned  over  to  check  for 
the  p (D) . 


Wason*s  THOG  Problem 

Another  logical  rule  that  has  been  investigated  within 
a problem  solving  framework  is  exclusive  disjunction.  This 
problem  was  designed  by  Wason  (1977b)  and  is  called  the 
"THOG"  problem.  As  in  the  selection  task  subjects  must  pos- 
tulate hypotheses,  but  in  the  THOG  problem  they  must  carry 
out  a combinatorial  analysis  for  each  hypothesis  to  solve 


the  problem. 


follows. 


subject  is  presented  with 


cle,  and  a white  circle.  They  are  then  informed  that  the  ex- 
perimenter has  written  down  one  of  the  shapes  (diamond  or 
circle)  and  one  of  the  colors  (black  or  white) . A name 
(THOG)  is  related  to  the  designs  by  the  following  rule:  "If 

any  one  of  the  designs  includes  either  the  color  I have  writ- 
ten down  or  the  shape  I have  written  down,  but  not  both, 
then  it  is  called  a THOG."  Subjects  are  then  told  that  the 
black  diamond  is  a THOG  and  that  they  must  decide  if  each  of 
the  remaining  shapes  is  a THOG,  is  n'ot  a THOG,  or  that  there 
is  insufficient  information  to  decide.  Performance  on  this 
problem  is  typically  slightly  better  than  on  the  selection 
problem — from  10%-30%  of  the  subjects  gave  the  correct  an- 
swer (e.g.,  Newstead,  Griggs  S Warner,  Note  2;  Wason  6 


Wason  (1977b)  designed  this  problem  so  that  if  the  for- 
mation of  hypotheses  along  with  a combinatorial  analysis  is 
not  carried  out,  a "mirror  image"  of  the  correct  answer  will 
be  given.  In  fact,  this  erroneous  answer — that  the  white 
diamond  and  black  circle  are  THOGs  (or  indeterminate)  and 
that  the  white  circle  is  not  a THOG — accounts  for  over  50% 
of  the  errors  made  and  is  referred  to  as  the  ‘intuitive" er- 
ror (Wason  & Brooks,  1979) . The  correct  answer  to  the  prob- 
lem is  that  the  white  diamond  and  the  black  circle  are  not 
THOGs  and  the  white  circle  is  a THOG.  The  logic  of  the 


problem  is  as  follows:  We  know  that  the  black  diamond  is  a 

THOG  (given).  Thus,  because  of  the  stated  rule,  the  exper- 
imenter must  have  written  down  either  black  and  circle  or 
white  and  diamond.  If  the  experimenter  wrote  down  black  and 
circle,  the  white  diamond  cannot  be  a THOG  because  it  has 
neither  attribute,  the  black  circle  cannot  be  a THOG  because 
it  has  both  attributes,  and  the  white,  circle  must  be  a THOG 
because  it  has  only  one  attribute.  The  same  conclusion  fol- 
lows in  the  alternative  ease.  If  the  experimenter  wrote 
down  white  and  diamond,  the  white  diamond  cannot  be  a THOG 
because  it  has  both  attributes,  the  black  circle  cannot  be  a 
THOG  because  it  has  neither  attribute,  but  the  white  circle 
must  be  a THOG  because  it  has  only  one  attribute.  Thus,  for 
both  possible  combinations  the  white  circle  is  a THOG  and 
the  black  circle  and  white  diamond  are  not  THOGs. 

There  are  several  hypotheses  as  to  why  subjects  fail  to 
carry  out  the  analyses  necessary  to  solve  the  problem.  One 
set  of  hypotheses  focuses  on  the  structure  of  the  task  it- 
self. It  is  possible  that  a subject's  attention  is  drawn  to 
the  instantiated  design — the  black  diamond — and  that  they 
reason  from  this  specific  instance  rather  than  from  what  must 
have  been  written  down  based  on  this  instance  and  the  rule. 
This  behavior  is  suggested  by  the  prevalence  of  the  "intui- 
tive" error  and  is  very  similar  to  the  matching  bias  observed 
in  the  selection  task.  Subjects  call  any  design  that  is  ei- 
ther black  or  a diamond  a THOG  and  a design  with  neither  of 
these  attributes  not  a THOG  (Griggs  & Newstead,  Note  3). 


An  additional  problem  related  to  this  approach  is  that 
subjects  may  be  unable  to  separate  out  the  attributes  of  the 
design  and  attempt  to  reason  about  the  design  itself.  This 
leads  to  a conceptual  difficulty  because  the  two  instances 
of  a THOG  necessarily  have  no  property  in  common  (Wason, 
1978)  . 


It  is  also  possible  that  the  abstract  terms  that  are 
utilized  in  the  THOG  problem  lead  to  difficulties  in  logical 
reasoning.  However,  merely  phrasing  the  problem  in  realistic 
terms  does  not  improve  performance  (Cordell,  1978;  Newstead 
et  al..  Note  2,  Experiments  1 and  2),  but  performance  is  im- 
proved by  making  the  correct  answer  congruent  with  experience 
(Newstead  et  al..  Note  2,  Experiment  3).  There  is  strong 
support,  however,  for  the  hypothesis  that  this  improvement 
is  not  due  to  improved  logic  but  to  memory  cuing.  When  New- 
stead et  al.  (Note  2,  Experiment  3)  asked  subjects  to  jus- 
tify or  explain  their  answers  to  the  experience-congruent 
THOG  problem,  only  three  of  the  13  subjects  who  answered  cor*- 
rectly  gave  answers  that  referred  to  some  sort  of  logic. 

The  other  subjects  referred  specifically  to  prior  experience 
or  knowledge. 

In  addition,  Newstead  et  al.  (Note  2,  Experiment  *S) 
found  that  eight-year-old  children  demonstrated  excellent 
performance  on  an  experience-congruent  THOG  task.  Since 
most  researchers  would  agree  that  these  children  do  not  pos- 


combinatorial 


analysis,  their  behavior  must  be  the  result  of  a nonlogical 
response  bias,  namely  memory  cuing. 

Various  therapeutic  procedures  have  been  utilized  as 
well,  with  no  improvement  in  performance.  Hasan  and  Brooks 
(1979)  had  subjects  produce  the  possible  hypotheses,  but  per- 
formance still  did  not  improve,  other  variations  include 
specifying  an  example  as  not  a THOG  (Griggs  & Newstead,  Note 
3) , and  separating  the  attributes  from  a particular  in- 
stance (e.g. , Cordell,  1978;  Newstead  et  al..  Note  2),  with 
little  difference  in  correct  performance  rate.  As  with  the 
selection  task,  it  is  obvious  that  most  subjects  do  not  ap- 
pear to  be  utilizing  a truth-table  combinatorial  analysis 
in  attempting  to  solve  the  THOG  problem. 


CHAPTER  4 

GOAL  OP  DISSERTATION 

The  major  characteristics  of  formal  operations  are  the 
ability  to  formulate  and  test  hypotheses,  to  isolate  and  con- 
trol variables,  to  carry  out  combinatorial  analyses,  and  to 
correctly  interpret  the  results  of  experimentation.  One  of 
the  least  investigated  aspects  of  formal  operations  is  the 
hypothesized  propositional  logic  basis  of  these  abilities. 

The  goal  of  this  dissertation  is  to  investigate  this  hypoth- 
esis in  two  ways:  (1)  by  examining  whether  performance  on 

traditional  Piagetian  tasks  and  on  hypothetico-deductive 
problems  which  are  based  directly  on  propositional  logic 
rules  is  related  and  (2)  by  examining  performance  on  Piaget- 
ian tasks  employing  specific  logic  probes. 

Experiment  1 examines  the  relationship  between  perfor- 
mance on  paper-and-pencil  versions  of  traditional  Piagetian 
tasks  and  performance  on  two  propositional  logic  tasks — the 
selection  task  and  the  THOG  problem.  Wason  (e.g.,  1977a) 
has  suggested  that  the  poor  performance  on  these  logic  tasks, 
especially  the  selection  task,  is  enough  evidence  to  serious- 
ly undermine  the  logical  bases  of  Piaget's  theory  of  formal 
operations.  It  seems  theoretically  impossible  for  proposi- 
tional logic  to  underlie  formal  operational  behavior  but  not 
a task  based  more  directly  on  a logical  rule,  as  are  both  the 


selection  task  and  the  THOG  problem.  If  this  ability  under- 
lies performance  on  both  of  these  types  of  tasks,  performance 
on  the  tasks  should  be  correlated. 

Three  additional  factors  that  have  been  linked  to  formal 
operational  ability  will  be  investigated  as  well.  It  is  pos- 
sible that  these  factors  will  influence  performance  on  one 
or  both  of  the  types  of  problems  being  investigated.  Past 
classroom  experience  will  be  investigated  by  recording  the 
number  of  classes  and  laboratories  in  mathematics,  chemistry, 
physics  and  logic.  Scholastic  Aptitude  Test  scores  will  be 
recorded  as  a measure  of  general  ability.  In  addition,  the 
Group  Embedded  Figures  Test  will  be  administered  as  a measure 
of  field  dependonce/independence . 

Experiment  2 employs  paper-and-pencil  versions  of  two 
traditional  Piagetian  tasks,  but  specific  questions  based  on 
propositional  logic  and  isolation  and  control  of  variables 
are  utilized.  Not  only  does  this  procedure  control  for  pos- 
sible ambiguity  of  task  instructions,  but  it  allows  the  use 
of  reasoning  congruent  with  propositional  logic  even  if  this 
logic  would  not  be  expressed  spontaneously.  Thus,  this  ex- 
periment employs  a more  sensitive  measure  of  the  use  of  prop- 
ositional logic  than  the  traditional  Piagetian  task.  As  in 
Experiment  1,  the  relationship  of  the  number  of  relevant 
classes  and  laboratories  taken  and  Scholastic  Aptitude  Test 


investigated. 


CHAPTER  E 
EXPERIMENT 


Experiment  1 was  conducted  to  investigate  the  relation- 
ship between  formal  operational  ability,  logical  ability, 
field  dependence/independence , past  classroom  experience, 
and  a measure  of  general  overall  ability.  Many  researchers 
have  hypothesized  relationships  between  various  combinations 
of  these  factors  (e.g.,  Flexer  s Roberge,  1980;  Neimark, 
1975;  Piaget,  1972;  Pulos  S Linn,  in  press;  Wason,  1977), 
but  as  of  yet  no  within-subjects  experiment  has  investigated 
all  of  them.  Specifically,  the  examination  of  the  relation- 
ship between  performance  on  the  formal  operational  tasks  and 
on  the  logic  tasks  is  intended  as  a test  of  Piaget's  asser- 
tion that  propositional  logic  underlies  formal  operational 
abilities  (Inhelder  a Piaget,  1958) . 

Although  the  formal  operational  tasks  used  in  this  ex- 
periment were  group-administered  paper-and-pencil  tests, 
they  were  designed  to  be  as  close  as  possible  to  those  used 
in  Inhelder  and  Piaget's  (1958)  experiments.  Recently,  some 
researchers  have  been  focusing  on  only  one  aspect  of  formal 
operational  thinking  (e.g.,  Barratt,  1975;  Kuhn  S Brannock, 
1977) , but  the  tasks  in  the  present  experiment  allowed  for 
a wider  range  of  abilities  to  be  expressed.  In  addition. 


permutation  ability 


measured  separately. 


The  logic  tasks  administered  were  the  abstract  selec- 
tion problem  and  THOG  problem.  These  problems  indirectly 
test  propositional  logic  abilities  in  a problem-solving 
framework,  as  Piaget  has  proposed  for  the  solution  to  his 
formal  operational  tasks.  One  question  of  particular  inter- 
est is  whether  subjects  who  do  well  on  these  tasks  also  do 
well  on  the  formal  operational  tasks.  This  result  would 
support  Piaget's  hypothesis  that  propositional  logic  under- 
lies formal  operational  abilities. 

The  Group  Embedded  Figures  Test  (Oltman,  Raskin  i wit- 
kin,  1971)  was  administered  as  a test  of  field  dependence/ 
independence.  There  is  evidence  that  this  trait  correlates 
with  formal  operational  ability  (e.g. , Neimark,  1975) . It 
is  also  plausible  that  the  ability  to  extract  important  var- 
iables from  irrelevant  background  "noise”  (i.e.,  field  inde- 
pendence) is  important  for  successful  performance  on  the  log- 
in addition,  past  classes  and  laboratories  taken  in 
mathematics,  chemistry,  physics,  and  logic  in  both  high 
school  and  college  were  examined.  As  Piaget  has  stated 
(Piaget,  1972) , specific  past  experience  may  be  the  most  im- 
portant indicator  of  performance  within  a particular  domain. 
Since  the  problems  utilized  in  this  experiment  are  science- 
based,  the  above  classes  and  laboratories  seemed  to  be  the 
most  appropriate  ones  to  investigate. 


general  abilities — Scholastic 


Aptitude  Test  (Verbal)  (SAT(V)]  and  Scholastic  Aptitude  Test 
(Quantitative)  (SAT(Q)]  scores — was  recorded.  It  is  possible 
that  a student  will  perform  well  on  all  tasks  because  of  some 
more  general  ability  rather  than  because  of  logical  ability 
or  scientific  reasoning. 


Method 

Ninety-one  students  at  the  University  of  Florida  served 
as  subjects  in  this  experiment  as  partial  fulfillment  for 
course  requirements  in  introductory  psychology.  Forty-six 
subjects  were  female,  and  45  were  male. 

Materials 

As  a measure  of  field  independence,  the  Group  Embedded 
Figures  Test  (GEFT)  developed  by  Witkin  and  his  colleagues 
(Oltman,  et  al.,  1971)  was  administered  to  all  subjects.  To 
assess  formal  logic  abilities,  two  problems  were  formulated. 
One  problem,  a version  of  Mason's  selection  task,  is  based 
on  the  propositional  logic  rule  of  implication.  In  addition, 
subjects  were  asked  to  justify  their  answer  after  it  had  been 
given.  This  problem  along  with  the  justification  sheet  is 
given  in  Appendix  A.  The  second  problem,  a version  of 
Mason's  THOG  problem,  is  based  on  the  propositional  logic 
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rule  o£  exclusive  disjunction.  Subjects  were  also  asked  to 
justify  their  answer  to  this  problem.  The  justification 
sheet  and  the  problem  are  given  in  Appendix  B. 

Pour  paper-and-pencil  problems  were  developed  as  a meas- 
ure of  formal  operations.  Three  problems  were  based  very 
closely  on  three  of  the  15  problems  described  in  Inhelder 
and  Piaget  (1958) — the  bending  rods  problem,  the  pendulum 
problem,  and  the  combination  of  colorless  chemicals  problem. 
The  format  of  the  problems  was  based  on  a group-administered, 
formal-operational  task  developed  by  Faust  and  Golembowski 
(Note  4) . Subjects  are  presented  with  a verbal  and  pictoral 
representation  of  the  problem  and  are  asked  to  describe  in 
writing  as  completely  and  exactly  as  possible  how  they  would 
solve  the  problem. 

These  three  problems  were  presented  together  in  a book- 
let preceded  by  an  information  and  instruction  page.  On 
this  page,  subjects  were  asked  to  list  all  the  classes  and 
laboratories  in  logic,  mathematics,  chemistry  and  physics 
that  they  had  taken  in  high  school  and  in  college.  The  in- 
structions informed  the  subjects  of  the  nature  of  the  task 
and  the  importance  of  answering  the  questions  completely  and 
exactly.  This  problem  booklet  is  given  in  Appendix  C. 

(1975)  license-plate  problem  was  administered.  In  this  prob- 
lem, subjects  are  asked  to  produce  all  possible  license  plate 
numbers  from  a given  four  digit  license  plate.  Then, 
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subjects  are  asked  to  try  and  discover  a general  rule  that 
will  predict  the  number  of  possibilities  for  any  given  num- 
ber of  digits.  This  problem  is  given  in  Appendix  D. 


Procedure 


Subjects  w 
10  subjects  eac 
sessions  separated  by  o 
completed  th< 


operations  tasks  and  t 
had  indicated  that  mos 
group  in  approximately  a 
The  order  of  the  ta 


n in  same-sex  groups  of  from  eight  to 
s experiment  consisted  of  two  one-hour 
n one  session,  subjects 
a selection  problem,  and  the  THOG  prob- 
n consisted  of  the  booklet  of  formal 
he  permutation  task.  A pilot  study 
t subjects  would  complete  each  task 

sks  was  counterbalanced  both  over 
sessions  and  within  sessions  by  sex.  The  order  of  the  Pia- 
getian  tasks  within  the  test  booklet  was  randomized  as  well. 
The  general  layout  of  the  experiment  is  given  in  Table  2. 

All  tasks  were  self-paced  except  for  the  GEPT,  which  1 
is  a timed  test.  The  subjects  were  reminded  by  the  exper- 
imenter to  answer  the  questions  as  exactly  and  completely 
as  possible  before  each  session.  They  were  also  reminded 
that  the  appropriate  tasks  were  self-paced  and  that  they 
were  allowed  as  much  time  as  necessary  to  complete  the  task. 
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First,  the  descriptive  statistics  for  this  group  of 
subjects  will  be  discussed.  The  mean  age  was  19.27  years 
(SD=1.41) . The  mean  score  on  the  GEFT  was  12.16  points 
(SD=4.95).  The  highest  actual  score  was  18  points  and  the 
lowest  actual  score  was  0 points.  Only  84  of  the  91  sub- 
jects had  taken  the  SAT  exams.  The  mean  for  the  SAT  (0)  test 
was  507.62  points  (SD=108.56) . The  highest  actual  score 
was  710  points  and  the  lowest  actual  score  was  270  points. 

The  mean  score  for  the  SAT  (V)  test  was  481.67  points  (SD= 
105.99).  The  highest  actual  score  was  720  points  and  the 
lowest  actual  score  was  270  points.  The  mean  number  and 
range  of  classes  taken  in  each  subject  area  is  presented  in 
Table  3 . As  can  be  seen  in  Table  3 , the  mean  number  of  a 11 
classes  taken  was  below  one  class,  except  for  the  subject 
of  mathematics. 

Piagetian  Problems  ) 

Permutation  Problem.  The  permutation  problem  was 
scored  as  correct  if  the  subjects  successfully  permuted  the 
four  numbers  given  in  the  license  plate  to  produce  the  23 
additional  numbers.  Seventy-one  of  the  91  subjects  (78%) 
did  so.  The  other  subjects  only  partially  permuted  the  num- 
bers. Subjects  were  also  asked  to  deduce  (or  produce)  the 
general  formula  for  permutations.  Twenty-six  of  the  subjects 
(29%)  were  able  to  do  this.  The  remaining  subjects  either 


Mean  Number,  Standard  Deviation,  and  Range  of 
Classes  Taken  by  Subjects  in  Experiment  X 


Class 


Standard  Deviation 


Mathematics 

Mathematics 

(C) 

Mathematics  lab 
(C) 

Chemistry 

(HS) 

Chemistry  lab 

Chemistry 

(C) 

Chemistry  lab 
(C) 

Physics 

(HS) 

Physics  lab 
(HS) 
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gave  the  wrong  formula,  stated  that  they  did  not  know  the 
answer,  or  did  not  answer  the  question. 

Traditional  Plaqetian  Problems.  These  problems  were 
scored  according  to  the  scoring  system  given  in  Table  4. 

This  scoring  system  is  based  on  performance  descriptions 
given  by  Xnhelder  and  Piaget  (1958)  and  the  performance 
criteria  of  Martorano  (1977)  and  Peel  (1971) . The  problem 
booklets  were  taken  apart,  and  the  data  for  each  problem 
were  scored  independently  of  each  other.  Two  people  scored 
all  of  the  answers,  and  interrater  reliability  was  .90.  A 
mutual  decision  was  reached  on  all  problems  on  which  the 
raters  disagreed,  bringing  interrater  reliability  to  1.0. 

The  means,  standard  deviations,  and  number  of  subjects 
performing  at  each  level  are  given  in  Table  5.  These  data 
will  be  compared  with  those  of  Martorano  (1977)  because  of 
the  similarity  of  the  tasks  and  scoring  system.  Martorano's- 
data  for  twelfth  grade  subjects  are  also  given  in  Table  5 
(adjusted  down  for  a scale  difference  of  one  point) . The 
means  for  the  present  study  are  somewhat  lower  than  those 
reported  by  Martorano.  This  difference  in  overall  level  of 
difficulty  could  be  due  to  several  factors.  For  example, 
the  subject  pools  differ  in  both  number  and  makeup — Martor- 
ano's twelfth  grade  subjects  were  20  females.  Forty-five 
males  as  well  as  46  females  participated  in  this  study. 

Thus,  it  is  possible  that  this  larger  number  of  subjects  re- 
in a more  representative  sample  of  the  population. 


suited 
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Further  evidence  for  this  hypothesis  comes  from  the  standard 
deviations  for  each  mean — Maratorano's  subjects  performed 
with  standard  deviations  ranging  from  .56  to  .80  on  these 
tasks.  The  subjects  in  this  experiment  performed  with  stan- 
dard deviations  ranging  from  1.08  to  1.29,  reflecting  a 

However,  the  most  obvious  difference  between  these  two 
studies  is  in  the  form  of  the  problems.  The  problems  in 
this  study  were  paper-and -pencil  tasks.  Martorano's  sub- 
jects used  actual  task  apparatus,  and  both  verbal  and  non- 
verbal responses  were  scored.  It  is  possible  that  even 
though  subjects  were  given  as  much  time  as  necessary  to  an- 
swer each  problem,  a totally  written  response  is  more  influ- 
enced not  only  by  level  of  cognitive  ability,  but  also  by 
motivation,  verbal  ability,  and  so  on,  than  an  active  phy- 
sical response.  It  is  also  possible  that  behaviors  which 
would  naturally  occur  in  making  physical  responses  are  not 
thought  to  be  necessary  in  a written  response.  For  example, 
subjects  may  not  feel  that  it  is  necessary  to  state  that  a 
pendulum  should  be  held  at  the  same  level  before  letting  go 
during  each  test  of  a particular  factor,  and  yet  would  do  so 
during  an  actual  experiment.  Scorers  attempted  to  control 
for  this  type  of  error  by  giving  subjects  credit  if  the  con- 
cept of  control  was  mentioned  for  at  least  one  factor  that 
should  be  controlled,  but  there  are  many  possible  potential 
aspects  of  relevant  behaviors  that  subjects  may  not  have 


written  down  that  are  not  as  easily  checked  for.  Analyses 
investigating  the  relationship  between  performance  on  these 
tasks  and  verbal  ability  will  be  discussed  later  in  the  sec- 
tion called  Analyses  investigating  the  Relationship  Between 
Factors . 

One  related  trend  in  the  data  for  the  bending  rods  task 
however,  was  easily  discernable.  Many  subjects  stated  that 
they  would  test  all  possible  combinations  of  rods,  but  they 
did  not  state  which  factors  they  would  be  investigating  with 
each  combination.  This  error  placed  these  subjects  in  Level 
2,  in  which  a characteristic  response  is  to  carry  out  suffi- 
cient binary  combinations  but  be  unable  to  make  full  use  of 
the  information  obtained.  It  is  impossible  to  tell  whether 
or  not  subjects  actually  did  not  know  how  to  make  sufficient 
use  of  the  information  obtained  or  simply  did  not  write  down 
the  answer.  This  was  the  only  discernable  trend  of  this 


Even  though  the  mean  scores  are  concrete  operational  or 

task  reveals  that  most  subjects  scored  in  at  least  the  early 
formal  operations  level  for  both  the  pendulum  and  the  combi- 
nation of  colorless  chemicals  task.  The  number  of  subjects 
scoring  in  Level  2 for  the  bending  rods  task  was  the  result 
of  the  type  of  error  described  above.  Thus,  even  though 
mean  scores  were  lower  than  those  reported  previously  by 
Martorano  (1977) , the  number  of  subjects  scoring  in  the 


formal  operational  levels  is  relatively  high:  25  of  91  sub- 

jects in  the  bending  rods  task  (27%) , 50  of  91  subjects  in 
the  pendulum  task  (55%) , and  60  of  91  subjects  in  the  chem- 
icals task  (66%).  These  percentages,  along  with  the  percen- 
tage correct  for  permutations,  are  similar  to  those  reported 
by  Martorano  (1977)  except  for  the  bending  rods  problem. 
Sixty  percent  of  the  twelfth  grade  subjects  in  Martorano 
(1977)  performed  at  the  formal  operational  level. 


Propositional  Logic  Problems 

The  data  for  each  propositional  logic  task  were  scored 
independently  so  that  performance  on  one  task  would  not  in- 
fluence the  scoring  of  the  other  task.  Answers  were  scored 
as  correct  (2) , partially  correct  (1) , or  incorrect  (0) . For 
both  tasks,  any  response  pattern  which  was  partially  correct 
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given.  These  partially  c 
tfhich  occurred. 


response  choices . 1 


answer  given.  All  justifications  were  scored  as  correct  (1) 

logical  rule.  The  justification  for  every  card  had  to  be 
correct  for  a justification  score  of  one  to  be  given.  If 

as  their  final  answer.  Thus,  if  while  justifying  an  incor- 
rect answer  the  subject  realized  his  or  her  mistake  and  rec- 
tified it  with  a correct  answer  and  justification,  full  cred- 


Selection  Task.  The  data  for  the  selection  problem  are 
given  in  Table  6.  These  results  are  like  those  typically 
found  in  previous  studies  using  the  abstract  selection  prob- 
lem (e.g.,  see  Griggs  s Cox,  in  press).  The  number  of  sub- 
cause of  the  number  of  subjects  changing  their  answer  to 
the  correct  one.  Only  five  of  91  subjects  originally  chose 
the  correct  cards,  which  is  closer  to  the  typical  results. 

Many  subjects  chose  the  p and  q cards,  which  is  usually 
the  most  prevalent  answer,  presumably  because  of  a verifica- 
tion or  matching  bias  (e.g.,  Evans  a Lynch,  1973;  Wason, 


Subjects  justified  turning 


Response  Patterns  for  the  Selection 
in  Experiment  1 


Correct 


Scored  as  partially 


any  card  unless  it  was  turned  over.  The  remaining  nine  sub- 
jects mentioned  looking  Cor  a specific  symbol  on  the  back  of 
each  card,  which  can  be  more  readily  identified  as  the  use 
of  a biconditional  rule.  As  discussed  in  Chapter  2,  a com- 

of  a biconditional  rule.  For  a biconditional  rule,  all  four 
cards  must  be  turned  over  in  order  to  check  for  falsifying 
cases.  It  is  also  possible  that  some  or  all  of  the  seven 
subjects  mentioned  above  may  have  been  using  a bicondition- 


All  subjects  who  made  the  correct  selection  justified 
their  answer  in  accordance  with  the  implication  rule.  The 
justifications  for  the  remaining  subjects'  choices  were  not 

except  for  those  who  appeared  to  be  using  a biconditional 
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91  subjects  (42.751)  changed  their  answer.  In  fact,  of  the 


beginning 


justification  process. 


justifica- 


THOG  Task.  The  response  patterns  for  the  THOG  problem 
are  presented  in  Table  7.  Again,  the  responses  are  similar 
to  data  in  previous  investigations  of  this  problem  (e.g., 
Wason  s Brooks,  1979) . The  majority  of  incorrect  responses 
correspond  to  the  "intuitive"  error — 29  of  the  91  subjects 
responded  AAB  and  13  responded  CCB  for  a total  of  46.0%  of 

justification  for  an  intuitive  error  requires  the  subject  to 
state  that  a white  diamond  is  a THOG  (or  indeterminate)  be- 
cause it  has  one  of  the  characteristics  of  the  THOG  (the 

because  it  also  has  one  of  the  characteristics  of  the  THOG, 


and  the  white  circle  is  not  a THOG  because  it  has  neither  of 
the  characteristics.  All  of  the  subjects  making  this  error 
gave  this  justification,  but  only  one  subject  mentioned  the 
contradiction  in  this  answer;  namely  that  the  original  THOG 
(the  black  diamond)  cannot  be  a THOG  using  this  reasoning  be- 
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disjunctive  rule.  Thirteen  subjects  answered  partially 


Problem 


in  Experiment  1 


DScored  as  partially  correct. 

A response  pattern  of  BBC  was 
also  scored  as  partially  cor- 
rect, but  only  one  subject 


correctly  (one  subject  answered  BBC  and  is  included  in  the 
"other"  category)  because  they  failed  to  carry  out  totally 
the  required  combinatorial  analysis.  The  remaining  60  an- 
swers were  not  identifiable  as  conforming  to  any  proposition- 


al logic  rule. 

As  for  the  selection  task,  the  modification  of  answers 
during  justification  was  investigated.  Ten  subjects  changed 


wrong  to  a right  answer,  and  seven  changed  from  a wrong  to 
a partially  right  answer,  for  a total  of  29  of  91  subjects, 

did  so  during  the  justification  process.  As  in  the  selec- 
tion problem,  at  least  some  subjects  experience  insight  into 


Analyses  Investigating  the  Relationship  Between  Factors 

The  major  purpose  of  this  study  was  to  investigate  the 
relationship  between  the  measured  factors.  In  order  to  do 
this,  a correlation  matrix  was  formed  for  the  27  factors 
using  Pearson  product-moment  correlations.  This  correla- 

table,  many  intercorrelations  occur  between  the  variables, 
which  renders  interpretation  of  these  correlations  impos- 
sible because  of  confounding.  For  example,  sex  is  signif- 

but  the  number  of  classes  taken  in  chemistry  during  high 


ppppB 


school  is  significantly  correlated  to  both  sex  and  perfor- 

cern  if  the  effect  of  sex  on  the  THOG  problem  is  actually 
an  effect. due  to  sex  or  to  the  number  of  chemistry  classes 
taken  in  high  school.  Therefore,  the  significance  of  par- 
tial correlations  between  the  major  variables  was  investi- 
gated. Partial  correlations  allow  for  a measure  of  the  cor- 
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selected  factors  and  all 


(Kleinbaum  & Kupper,  1978;  Helwig  & Council,  1979) . The 
significant  partial  correlations  are  given  in  Table  9. 

comparisons  that  were  made  a more  reasonable  level  of  sig- 
nificance is  £<.01  to  guard  against  a Type  II  error.  SAT 
<Q)  and  SAT  (V)  scores  are  highly  correlated,  as  are  SAT  (Q) 
and  the  number  of  physics  classes  taken  in  college.  Since 
■ taken  before  the  physics  classes. 


Significant  Partial  Correlations  between  Selected 
Factors  in  Experiment  1 


l Correlation  F 


Selection  task,  Reasoning 
for  selection  task 

Bending  rods  task,  Pendulum  task 


laboratories  taken  in  college 
Reasoning  for  selection  task.  Age 
SAT  (Q) , Chemical  combinations  task 
Selection  task.  Sex 


s reasonable  to  conclude  that  subjects  w 
SAT  (Q)  exam  tend  to  take  more  physics  classes  in  col- 
an  those  students  who  score  lower  on  the  exam. 

The  reasoning  for  both  the  propositional  logic  tasks 
and  performance  on  these  tasks  are  highly  correlated  as  well. 

their  answers  correctly.  However,  the  relationship  between 
the  two  tasks  themselves  was  not  significant.  Examination 
of  the  subjects'  performance  on  both  tasks  reveals  that  six 
of  the  91  subjects  answered  both  tasks  correctly,  52  of  the 

problem  correctly  but  missed  the  selection  problem,  six  an- 
swered the  selection  problem  correctly  but  missed  the  THOG 

ous  combinations. 

Two  of  the  formal  operations  tasks  were  highly  corre- 
lated, the  bending  rods  task  and  the  pendulum  task.  Similar' 
results  have  been  reported  before  (e.g.,  Danner  & Day,  1977; 

This  may  be  because  the  different  tasks  measure  different 
aspects  of  formal  operational  ability.  Inhelder  and  Piaget 

as  measuring  multiplicative  compensation,  and  the  high  de- 
gree of  correlation  between  performance  on  these  two  tasks 


n necessary  ability.  In  addition, 
s only  combinatorial  ability,  while 
s permutational  ability.  T 


the  license  plate  t 

(as  demonstrated  by  the  Level  2 scores  on  the  bending  rods 
task  mentioned  previously) . 

One  of  the  more  striking  aspects  of  the  data  in  Table 
9 is  the  lack  of  correlations  between  the  logic  tasks  and 
the  Piagetian  tasks.  In  addition,  the  correlation  between 
these  tasks  and  past  classes  is  marginal  o 
is  the  relationship  between  any  of  the  tas 
SAT  (V) , or  C 


the  logic  tasks  and  any  of  the  Piagetian  tasks  may  indicate 
the  existence  of  separate  underlying  cognitive  abilities. 
Since  the  logic  tasks  are  based  directly  on  a specific  prop- 
ositional logic  rule  but  the  formal  operational  tasks  are 
only  theoretically  linked  to  propositional  logic,  alterna- 
tive abilities  (such  as  isolation  and  control  of  variables) 
appear  to  be  more  crucial  for  successful  behavior  on  tradi- 

(1978)  found  similar  results  using  a principle-components 
analysis  on  their  data.  Lawson  et  al . (1978)  administered 
seven  formal  operational  tasks,  two  of  which  were  proposi- 
tion task.  The  five  tasks  used  to  measure  three  formal 


abilities  (proportions,  correlations  and  probability)  had 
principle  loadings  on  one  factor  and  the  two  propositional 
logic  tasks  had  principle  loadings  on  a second  factor.  Law- 
son  et  al.  also  argue  that  the  isolation  and  control  of  var- 
iables may  be  the  principle  ability  that  constitutes  formal 
thought.  They  further  suggest  that  the  term  "formal  thought 
be  replaced  by  the  term  hypothetico-deductive  thought  since 
formal  logic  does  not  appear  to  underlie  thought  in  this 

The  lack  of  relationship  between  science  training  and 
formal  operational  ability  has  been  discussed  by  several  re- 
searchers, as  mentioned  in  Chapter  1.  Even  though  Piaget 
(1972)  modified  his  theory  to  accommodate  the  effects  of 

and  the  framework  in  the  problem  must  occur.  Recent  studies 
based  on  this  hypothesis,  however,  have  not  always  been  suc- 
cessful (e.g..  Capon  6 Kuhn,  1979).  Also,  only  the  number 

the  grade  received  or  the  understanding  obtained  in  each 
course,  which  probably  is  the  critical  variable. 

Previous  studies  have  indicated  a relationship  between 
field  dependence/independence  (as  measured  by  the  GEPT  in 

Linn,  1978;  Neimark,  1975;  Pascual-Leone , 1970) . Other  stud 


two  factors  (e.g.,  Saarnl,  1973).  Plexer  ana  Roberge  [1980) 

primarily  to  their  common  overlap  with  IQ  (as  measured  by 
Lorge-Thorndike  Intelligence  Tests) . Although  the  SAT  exam- 

eral  ability,  so  it  was  unusual  to  find  no  relationship  be- 
tween at  least  some  of  these  factors.  Therefore,  an  addi- 

As  a final  measure  of  the  relationships  between  the 
factors  measured  in  this  study,  a series  of  stepwise  regres- 

variables.  All  possible  models  are  tested  for  the  best  pre- 
dictor or  predictors  of  performance,  i.e.,  those  variables 
that  account  for  the  most  variance  as  measured  by  r . 

Because  of  the  intercorrelations  between  many  of  the 
factors,  measures  were  collapsed  into  their  respective  over- 

bined  to  form  a measure  called  SAT.  The  numbers  of  classes 
and  laboratories  taken  in  all  four  areas  were  collapsed  in- 
to a total  measure  of  classes  taken.  The  permutation  and 
permutation-formula  scores  were  combined,  as  were  the  selec- 
tion task  and  selection-reasoning  scores  and  the  THOG  task 
and  TlIOG-reasoning  scores.  The  measures  of  sex,  GEPT,  and 
the  scores  on  the  bending  rods,  pendulum,  and  c 


colorless  chemicals  tasks  were  not  collapsed.  This  left  a 
total  of  10  factors.  Stepwise  regressions  were  run  for  the 
dependent  variables  of  selection  score,  THOG  score,  permuta- 
tion score,  bending  rods  score,  pendulum  score  and  combina- 
tion of  colorless  chemicals  score  to  discover  the  best  pre- 


The  best  one-,  two-,  and  three-variable  models  for 

in  Table  10.  No  variable  entered 

in  Table  10,  SAT  is  the  best  predictor  of  performance  on  bo 
of  the  logic  tasks  and  two  of  the  formal  operations  tasks 
(permutations  and  chemical  combinations) . 

For  each  of  the  logic  tasks,  the  other  logic  task  en- 
ters into  the  model  second,  and  sex  enters  third.  However, 


only  approximately  20%  of  the  variance  is  accounted  for  by 
the  best  three  predictors  of  performance  on  the  logic  tasks.. 
None  of  the  remaining  variables  were  significant  predictors 


for  permutational  ability  than  the  traditional  Piagetian 
the  only  significant  predictor  of  permutational  ability,  and 
variable  model. 

The  best  predictors  for  each  of  the  three  traditional 


formal  operational 


accounted  for 


: (which  never  accounts  for  a signif- 

rom  33%  to  45%  of  the  variance 
is  accounted  for  by  the  best  three-variable  model  for  the 
tasks,  and  no  other  variables  were  significant  predictors 
of  performance. 

the  best  three-variable  models  f 
the  Piagetian  problems  could  be  because  of  two  factors.  One 

ic  tasks  than  on  the  Piagetian  tasks;  and  since  subjects 
performed  uniformly  badly,  none  of  the  factors  predict  per- 
formance very  well.  On  the  other  hand,  it  is  possible  that 
unknown  variables  not  entered  into  the  analysis  contribute 
more  to  performance  on  the  logic  tasks;  and  variables  in  the 
analysis  were  sufficient  to  contribute  significantly  to  the 
Piagetian  tasks.  This  is  support  for  the  hypothesis  that 
different  abilities  underlie  the  two  types  of  tasks,  as  pro- 
posed by  Lawson,  Xarplus,  and  Adi  (1978) . Further  support 

els — although  SAT  is  a predictor  for  both  types  of  tasks, 

similar  tasks. 

Since  SAT  was  a better  predictor  than  the  total  number 
of  classes  taken,  general  ability  appears  to  be  more  impor- 

tioned  before,  however,  different  results  may  have  occurred 


f understanding 
ather  than  merely  the  numb* 


subject  matter  had  been  measured 

cognitive  abilities  underlie 


the  logic  tasks  and  the  traditional  Piagetian  tasks,  then 
typical  performance  on  the  selection  task,  for  example,  is 

Hason  (1977a)  claims.  However,  it  does  appear  that  the  use 
of  propositional  logic  does  not  underlie  performance  on  tra- 
ditional Piagetian  tasks,  because  the  logic  tasks  are  based 
strictly  on  propositional  logic  rules  and  poor  performance 

pears  to  be  the  most  important  factor  for  successful  perfor- 
mance on  Piagetian  tasks  using  traditional  performance  cri- 
teria. Also,  the  lack  of  correlation  between  performance  on 
the  selection  task  and  on  the  THOG  task  is  evidence  that  the 
two  rules  on  which  they  are  based  (implication  and  exclusive 
disjunction)  are  not  linked  together  psychologically  by  the 


The  importance  of  SAT  scores  for  predicting  behavior  on 
the  logic  tasks  and  on  the  Piagetian  tasks  does  provide  a 
link  between  them,  but  a more  important  factor  seems  to  sep- 
arate task  performance.  It  remains  to  be  seen  whether  this 
factor  is  task  differences  or  truly  a cognitive  ability  dif- 
ference, such  as  amount  of  working  memory  necessary  to  solve 
the  task,  heuristic  choice,  or  some  other  ability. 


Experiment  1 demonstrated  that  the  use  of  propositional 
logic  is  not  necessary  for  successful  performance  on  tradi- 
tional Piagetian  tasks.  Experiment  2 was  conducted  to  probe 
more  specifically  for  the  use  of  propositional  logic  in  solv- 
ing such  problems  as  well  as  for  the  use  of  more  general  for- 
mal operational  abilities.  Two  problems  from  Experiment  1 — 

were  chosen  because  they  were  suited  for  the  modifications 
introduced  in  this  experiment  and  because  performance  on 
these  tasks  was  highly  related  in  Experiment  1.  Formal  op- 
erational subjects  should  be  able  to  answer  specific  logical 

the  use  of  propositional  logic  in  solving  problems  like  those 
in  Experiment  1. 

tasks  and  on  the  Piagetian  tasks  in  Experiment  1 may  have 

ist  for  the  use  of  propositional  logic  in  solving  open-ended 
traditional  Piagetian  problems,  it  is  possible  that  subjects 
will  use  propositional  logic  if  the  specificity  of  the  ques- 
tions makes  it  necessary  for  successful  performance.  The 


probes  used  in  Experiment  2 asked  for  specific  knowledge  of 
isolation  and  confounding  of  variables,  presented  results 
for  evaluation,  and  gave  specific  hypotheses  to  be  tested. 

propositional  logic  in  solving  traditional  formal  operation- 


Method 


Forty-six  students  at  the  University  of  Florida  served 
as  subjects  in  this  experiment  as  partial  fulfillment  for 
course  requirements  in  introductory  psychology  classes.  None 
of  the  subjects  had  participated  in  Experiment  1.  Twenty- 
four  of  these  subjects  were  female,  and  22  were  male. 


Materials 

ministered  in  Experiment  1 were  modified  for  this  experiment. 

and  nine  questions  were  formulated  for  the  pendulum  problem. 
Each  problem  was  designed  to  take  approximately  an  hour  to 

The  questions  in  each  problem  were  formulated  to  assess 
both  general  formal  operational  abilities  as  well  as  the 


be  seen  in  Appendix  K,  the  first  five  questions  for  each 
problem  are  very  similar.  These  probes  are  based  on  some 
questions  from  a group-administered  test  of  formal  opera- 
tions developed  by  Tomlinson-Keasey  and  Campbell  (Note  5) . 
The  first  question  tests  spontaneous  knowledge  of  the  rele- 
vant factors  for  each  problem.  Questions  2 and  3 test  for 
the  ability  to  isolate  and  test  variables.  Questions  4 and 
5 test  for  the  ability  to  recognize  the  confounding  of  var- 


The  remaining  questions  were  designed  to  tap  the  use  or 
nonuse  of  propositional  logic  rules.  In  the  bending  rods 
problem,  the  hypotheses  to  be  tested  and  the  results  are 
stated  such  that  in  logical  nomenclature  p and  q could  re- 
fer to  the  two  factors  of  length  and  material  (see  Dawes, 
1972  and  Ginsberg  s Opper,  1979) . For  example,  if  p refers 
to  long,  p refers  to  short;  and  if  q refers  to  brass,  q re- 
fers to  steel.  Thus,  the  four  possible  combinations  of 
these  factors  result  in  the  four  primary  conditions  in  the 


pq  (the  long  steel  bar) 


The  results  of  experimentation  are  then  represented  by  a 1 
(for  a positive  result,  such  as  the  bar  bends) , or  a 0 (for 
a negative  result,  such  as  the  bar  does  not  bend) . Each 


pattern  of  results  corresponds  to  a propositional  rule  in 
Table  1.  For  example,  suppose  the  following  results  occurred: 
pq  1 (the  long  brass  bar  bends) 
pq  1 (the  long  stoel  bar  bends) 
pq  0 (the  short  brass  bar  does  not  bend) 
pq  0 (the  short  steel  bar  does  not  bend) . 


This  pattern  of  results  corresponds  to  the  rule  affirmation  o 
g and  can  be  stated  as  long  bars  bend  more  than  short  bars. 


for  t 


s necessary  conditions  f 


s hypothesis  t 


esis  to  be  true.  The  use  of  a particular  logical  rule  to 
answer  the  question  can  be  assessed  by  the  two  types  of  con- 
ditions stated  by  the  subject.  This  particular  hypothesis, 

elusive  disjunction  or  affirmation  of  q.  To  illustrate  dif- 


the  affirmation  interpretation  will  be  contrasted.  If  sub- 


If,  on  the  other  hand,  subjects  conform  to  an  affirmation  of 
g rule,  the  following  statements  would  be  given: 
pg  1 (the  long  brass  bar  should  bend) 
pq  0 (the  long  steel  bar  should  not  bend) 
pg  1 (the  short  brass  bar  should  bend) 
pq  0 (the  short  steel  bar  should  not  bend) . 


from  the  one  stated  in  the  previous  question.  3 
interpret  "reversaln  as  Piaget  does  (in  terms  oi 
group)  and  used  an  implication  rule  in  Question 
to  Brainerd  (1978,  see  Table  6-2) , they  should  < 


hypothesis 
f subjects 


pg  1 (the  long  brass  bar  should  bend) 
pq  1 (the  long  steel  bar  should  bend) 
pq  0 (the  short  brass  bar  should  not  bend) 
pq  1 (the  short  steel  bar  should  bend) . 

If  affirmation  of  q was  the  rule  used  in  Question  6,  subjects 

pq  0 (the  long  brass  bar  should  not  bend) 
pq  1 (the  long  steel  bar  should  bend) 

pq  1 (the  short  steel  bar  should  bend) . 


In  Question  8,  the  subject  is  told  that  both  the  20- 


on  these  results.  The  expected  conclusion 


conclusion  based 


long  bars 


bars.  Subjects 


these  results  existed.  For  example,  iC  affirmation  of  p is 
the  interpretation  of  this  conclusion,  the  existence  of  the 

short  steel  bar  bends)  would  be  disproving. 


Question  9 also  states  specific  results,  and  the  subject 
to  form  a conclusion.  It  is  stated  that  the  only 
bends  is  the  10-inch  steel  bar.  These  results  rep- 
n example  of  a logically  possible  case  (conjunctive 
egation)  that  is  not  congruent  with  everyday  experience  or 

, the  conclusion  would  be  stated  as  neither  length 
r material  have  an  effect  on  the  bending  of  the  bars. 


1 question  i: 


e bending  rods  problem  states 


and  the  subject  is  asked  to  state  which  results  must  exist 
and  must  not  exist  for  this  hypothesis  to  be  true.  Two  pos- 
sibilities for  the  logical  rule  interpretation  of  this  prob- 
lem are  biconditional  and  conjunction.  If  subjects  conform 
to  a biconditional  rule,  the  following  statements  would  be 

pq  1 (the  long  brass  bar  should  bend) 
pq  0 (the  long  steel  bar  should  not  bend) 


should 


However,  if  subjects  conform  to  a conjunction  rule,  the  fol- 
lowing statements  would  be  given: 

pq  1 (the  long  brass  bar  should  bend) 
pq  0 (the  long  steel  bar  should  not  bend) 
pq  0 (the  short  brass  bar  should  not  bend) 

In  the  pendulum  problem,  the  last  four  questions  are  de- 
signed to  assess  the  use  or  nonuse  of  propositional  rules  as 
well  as  the  use  of  control  of  variables.  In  these  questions, 
the  hypotheses  and  results  are  stated  such  that  p and  q can 
refer  to  the  dependent  and  independent  variables,  respective- 
ly (see  Dawes,  1972) . Since  this  problem  involved  more  var- 
iables that  should  be  held  constant  than  the  bending  rods 
problem,  only  nine  questions  were  asked  so  that  the  subject 
could  complete  the  problem  in  approximately  an  hour.  The 
questions  are  very  similar  in  logical  structure  to  the  bend- 
ing rods  questions,  and  thus  will  not  be  discussed  in  detail 
(see  Appendix  B) . 

In  addition,  the  information  and  instruction  sheet 
utilised  in  Experiment  1 was  modified  for  use  in  this  exper- 
iment. The  same  information  concerning  laboratories  and 
classes  was  asked  of  the  subject,  but  subjects  were  only  in- 

This  information  sheet  is  given  in  Appendix  E.  The  subjects 
were  given  specific  instructions  on  the  first  page  of  each 
problem.  They  were  told  to  answer  each  question  as  exactly 


and  completely  as  possible  and  were  told  to  answer  each  ques- 


Procedure 

10  subjects  each  in  two  one-hour  sessions  separated  by  one 
day.  The  subjects  completed  the  .information  sheet  on  the 
first  day.  and  then  were  given  one  of  the  problems  to  solve. 
The  order  of  presentation  of  the  two  problems  was  counterbal- 
anced within  sex.  Subjects  were  told  that  the  problems  were 

necessary  to  complete  the  tasks.  They  were  also  reminded  to 
answer  each  question  as  exactly  and  completely  as  possible 
and  to  ask  the  experimenter  if  they  had  any  questions  con- 
cerning the  task. 


The  average  age  of  the  subjects  was  19.65  years  (SD= 
3.21) . Since  the  classes  taken  in  Experiment  1 were  so  high- 
ly intercorrelated,  the  total  number  of  classes  taken  for 
each  subject  was  calculated  and  used  in  all  further  analyses. 

was  10.19  (SD-5.15).  The  greatest  number  of  classes  taken 
was  28,  and  the  fewest  was  two.  A total  SAT  score  was  also 
calculated  and  used  in  all  further  analyses  because  of  the 


high  correlation  between 


in  Experiment 


points  (SD=1 


e highest  actual  s 


The  first  question  was  scored  by  counting  the  number  of 
factors  listed  that  could  affect  the  bending  of  the  bars. 

It  was  anticipated  that  three  factors  would  be  listed  by 

ones  to  list  from  reading  the  description  of  the  problem. 
These  three  factors  were  the  length  of  the  bar,  the  material 

the  bar.  The  mean  number  of  these  expected  factors  listed 

also  counted.  These  factors  included  such  variables  as  which 
position  the  bar  is  in,  the  atmospheric  conditions  of  the 
test  (e.g.,  normal  versus  in  a vaccuum) , and  where  the  weight 

reported  was  1.76  (SD=1.71). 

or  incorrect  (0) . Thirty-nine  of  the  46  subjects  (85%)  an- 
missed  one  question,  and  two  subjects  missed  two  questions. 
98%,  96%  and  93%,  respectively.  Forty-five  of  the  46  sub- 


subjects  stated 


logical  rule  affirmation  of  q.  These 


affirmation 


i the  brass  bars.  The  remaining  subject  answered  i 
length  rather  than  material. 

same  45  subjects  answered  Question  7 in  terms  of 
c; , but  the  rule  was  actually  stated  in  terms  of 

ch  is  an  equivalent  expression:  steel 

rass  bars.  This  reverse  hypothesis  is 


the  reverse  hypothesis  of  affirmation  of  q in  terms  of  the 
INRC  group  (Brainerd,  1978,  Table  6-2).  Subjects  answering 


pressed  reservations  about  the  hypothesis  based  on  her  past 
experience,  an  indication  of  a concrete-operational  level  of 
behavior.  The  same  subject  who  missed  Question  6 missed  this 
question  by  answering  "same  as  Number  6.” 

conclusion  from  these  results.  The  answers  fell  into  several 
categories.  These  categories  are  presented  in  Table  11  along 
with  the  number  of  subjects  answering  in  each  category. 

Most  of  the  subjects  (25  of  46  subjects)  gave  the  expected 
answer  that  length  was  the  crucial  factor  for  bending  of  the 
bars.  Fifteen  subjects  made  an  inference  about  the  results 


The  Number  of  Subjects  for  Each  Type  of  Answer  Given  to 
Question  8 on  the  Bending  Rods  Problem  (Experiment  2) 


Length  is  the  crucial  variable 
The  strengths  of  brass  and  steel 


The  experiment  w 

The  results  are  not  possible 
Nothing  can  be  concluded 


these  subjects  also  stated  that  length  is  a factor  in  bend- 
ing. This  inference  about  the  results  can  bo  interpreted 
as  a higher-level  answer  than  stating  that  length  is  the  cru- 
cial variable  (Peel,  1971) . The  remaining  six  subjects  gave 
various  answers:  two  subjects  stated  that  the  experiment 

must  have  been  confounded  in  some  way,  one  subject  did  not 
accept  the  results,  two  subjects  stated  that  no  conclusion 
could  be  made  without  further  information,  and  one  subject 
stated  that  either  length  was  the  crucial  factor  or  the  ex- 
periment was  confounded. 

these  results  are  based  on  a logical  rule  which  does  not  have 
an  experiential  basis.  Answers  to  this  guestion  again  formed 
several  categories,  which  are  given  in  Table  12  along  with 
the  number  of  subjects  who  gave  each  answer.  No  subject 

tive  negation  t 


subjects  (23  of  46)  c 


e results  were  based  on.  Half  of  the 
ave  a restricted  answer;  namely  that 
the  short  steel  bar  bends.  This  answer  is  less  than  formal 
operational  because  it  is  restricted  to  the  specific  concrete 
evidence  at  hand  (e.g.,  Flavell,  1963;  Peel,  1971).  Thirteen 
subjects  stated  that  the  experiment  must  have  1 

from  the  results  without  further  information.  One  subject 
stated  that  the  results  were  not  possible,  and  four  subjects 
missed  the  question  by  leaving  it  blank. 


The  Number  of  Subjects  for  Each  Type  of  Answer  Given  to 


Answer 


2.  The  experiment  was  confounded  13 

3.  Nothing  can  be  concluded  5 

4.  Missed  the  question  4 

5.  The  results  are  not  possible  1 


ths  logical  rule  of  conjunction  by  stating  that  only  the 


e Pendulum  Problem 


problem. 


hat  four  factors  would  be  lis 
e factors  were  stated  in  the 

nt  of  weight  attached  to  the 


was  anticipated  t 
ed  by  most  subjects  since  thes 

length  of  the  string,  the  amoun 

force  behind  the  initial  swing, 
listed  for  these  expected  factors  was  3.22  (SD=.81) . The 
number  of  additional  factors  reported  was  1.87  (SD-1. 89) . 

Questions  2 through  5 were  scored  as  correct  (1)  or  in- 
correct (0) . Thirty-eight  of  the  46  subjects  (82.6%)  an- 

missed  one  question,  one  subject  missed  two  questions,  one 
subject  missed  three  questions,  and  two  subjects  missed  all 
four  questions.  The  mean  percents  correct  for  Questions  2 
through  5 were  89%,  91%,  91%  and  91%,  respectively. 

esis,  and  which  results  must  exist  and  not  exist  if  the  hy- 
pothesis was  true.  Thirty-eight  of  the  46  subjects  a 
the  question  correctly  by  stating  that  they  w 


pendulum  a 


t different  heights  and  time  the  number  of  swings 
r each  height.  In  addition,  they  stated 
that  pendulums  held  higher  must  swing  faster  than  pendulums 
held  lower  if  the  hypothesis  was  true.  These  subjects  dif- 
fered in  the  number  of  factors  that  they  stated  which  needed 
to  be  controlled.  The  factors  which  we 
listed  as  controlling  variables  were  tfc 
string,  the  amount  of  weight  added  to  t 
initial  force  of  propulsion.  Of  the  38 


he  string,  and  the 
I subjects  who  answered 
controlling  factors, 

13  subjects  mentioned 


5 factors  to  be  controlled,  and 
se  factors.  The  eight  subjects 

s scored  as  correct  or  they 


length  of  string  and  weight  a 
15  subjects  mentioned  all  thr 
who  missed  this  question  did 
were  not  specific  enough  to  b 
stated  that  height  would  not  matter  and  thus  did  not  answer 
the  question. 

Question  7 presents  results  and  probes  specifically  for  : 
mention  of  controlling  variables  by  asking  if  any  conditions 
must  be  met  before  the  results  are  interpretable.  Fourteen 
subjects  stated  that  no  conditions  had  to  be  met,  14  subjects 

two  controlling  variables.  One  subject  did  not  answer  this 
question.  Of  the  45  subjects  who  did  answer  the  question,  44 
correctly  interpreted  the  results  as  demonstrating  length  as 
the  crucial  variable.  One  subject  gave  no  answer  to  this 
part  of  the  question. 


A hypothesis  was  presented  in  Question  8,  and  the  sub- 

esis  and  what  results  must  exist  and  not  exist  for  the  hy- 
pothesis to  be  true.  Thirty-eight  of  45  subjects  (one  sub- 
ject did  not  answer  the  question)  or  84.41  of  the  subjects 

weight  and  time  the  resulting  number  of  oscillations  per 
minute.  Again,  subjects  differed  in  the  number  of  control- 
ling variables  listed — eight  subjects  listed  no  controlling 
variables,  six  subjects  listed  one,  eight  subjects  listed 
two,  and  16  subjects  listed  three  controlling  variables. 

Six  of  the  subjects  who  answered  this  question  incorrectly 
also  answered  Question  6 incorrectly.  Answers  were  judged 
as  incorrect  if  the  subject  stated  that  weight  did  not  af- 
fect oscillation,  or  if  their  answers  were  too  general  to  be 

Forty-one  of  the  forty-six  subjects  (89%)  answered  the 
last  question  for  the  pendulum  problem  correctly  by  stating 
that  short  strings  result  in  fewer  swings  per  minute,  with 
weight  not  affecting  the  rate  of  oscillation.  Three  of  these 
subjects  mentioned  controlling  the  height  of  release,  and 
two  subjects  mentioned  controlling  for  force  of  propulsion 
as  well.  Five  subjects  answered  incorrectly  and  one  subject 
did  not  answer  this  question. 


majority  of  subjects 


To  summarize  the  data  so  far,  the 

enough  to  elicit  this  behavior.  Thus,  it  is  possible  for 
subjects  to  be  logically  consistent  in  answering  questions 
and  to  evaluate  hypotheses  and  results  in  terms  of  proposi- 
tional logic,  at  least  for  the  questions  formulated  for 
this  experiment.  However,  based  on  the  results  of  Experi- 


open-ended  questions  utilized  in  the  traditional  Piagetian 
tasks.  The  use  of  isolation  and  control  of  variables  along 
with  the  use  of  combinations  appears  to  be  the  most  impor- 
tant behaviors  for  successful  performance  on  traditional 
Piagetian  tasks. 


The  majority  of  subjects  in  this  experiment  also  were 
able  to  isolate  variables  and  easily  recognize  confounded 
comparisons  of  variables.  Subjects  mentioned  the  control  of 
variables  with  a much  wider  range  of  responses.  This  may  be 
the  result  of  the  written  nature  of  the  task.  As  in  Experi- 
ment 1,  it  is  possible  that  some  subjects  simply  were  not  mo 
tivated  to  write  down  all  of  the  variables  that  it  is  truly 
necessary  to  control  in  a particular  experiment. 


Analysis  investigating  t 


on  the  questions  was  investigated  using  Pearson 


moment-product  correlations.  The  resulting  correlation  ma- 
trix is  given  in  Table  13.  These  correlations  will  be  dis- 
cussed in  detail  because  the  number  of  subjects  is  not  suf- 
ficient for  a partial  correlation  analysis.  Only  significant 
correlations  (£<.05)  will  be  discussed;  therefore,  "corre- 
lated” will  henceforth  refer  to  significantly  correlated. 

Both  the  age  and  the  number  of  classes  taken  are  correlated 
with  year  in  school  ( r- . 3 7 and  .50,  respectively),  which  are 
not  surprising  results.  Sex  is  correlated  with  SAT  score, 
(r=-.40)  with  males  scoring  higher  than  females.  Sex  is  al- 
so correlated  with  the  number  of  factors  given  in  the  pendu- 
lum problem  on  Question  1 (r=-.34) , with  males  again  with  a 
superior  score. 


The  number  of  classes  taken  is  correlated  with  SAT 

lum  problem — the  two  isolation  of  variables  questions  (r=.31 
and  .32  for  Questions  2 and  3)  and  Questions  7 and  8 (r=.41 
and  .39,  respectively).  Most  subjects  answered  Questions  6 
through  9 correctly,  and  performance  is  distinguished  pri- 
marily by  the  number  of  controlling  variables  mentioned  by 
the  subject.  Thus,  subjects  who  score  higher  on  the  SAT 
exam  and  have  taken  more  classes  tend  to  mention  more  con- 
trolling variables.  In  support  of  this  hypothesis,  SAT  is 

problems  (r-.39  for  the  bending  rods  problem  and  =.57  for 
the  pendulum  problem)  and  with  the  last  four  questions  in 
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Questions 


the  pendulum  problem  (r=.59,  .43,  .66  and  .49  for 
6 through  9,  respectively).  In  addition,  the  number  of  fac- 

questions  in  the  pendulum  problem  involving  isolation  of 
variables  (r=.31) , control  of  variables  (r=.37),  and  Ques- 
tions 6 (r=.57)  and  8 (r=.39).  This  pattern  of  correla- 
tions suggests  that  subjects  who  list  relevant  factors  in 
the  first  question  are  more  likely  to  control  those  factors 
in  later  questions.  The  questions  within  the  pendulum  prob- 
lem are  highly  intercorrelated  as  well,  which  reflects  the 
primary  basis  on  which  subjects'  performance  was  scored — 
control  of  variables. 

Performance  on  the  bending  rods  questions  does  not  ap- 
pear to  be  as  intercorrelated.  The  number  of  factors  listed 


is  correlated  with  performance  on  Question  8 {r=- . 32) . This 
negative  correlation  reflects  the  tendency  for  subjects  who 
listed  the  most  factors  to  state  that  length  was  the  rele- 
vant factor  in  bending  based  on  the  given  results.  Subjects 
who  listed  fewer  factors  tended  to  state  that  the  experiment 
was  confounded,  refused  to  accept  the  results,  or  stated 
that  nothing  could  be  concluded  without  further  information. 

The  number  of  additional  factors  listed  is  correlated 
with  performance  on  Question  9 (r=.30).  This  correlation  re 
fleets  the  tendency  for  subjects  who  listed  fewer  additional 
factors  to  state  the  restricted  answer  that  the  short  steel 
bar  bends.  Subjects  who  listed  more  additional  factors 


cept  the  results,  or  stated  that  more  information  was  needed 
before  a conclusion  could  be  drawn. 

Performance  on  the  two  questions  that  were  designed  to 
probe  for  recognition  of  confounded  variables  was  correlated 
as  well  (r=.38) . Also,  performance  on  Questions  6 and  7 was 
perfectly  correlated  <r=1.00).  This  reflects  the  fact  that 
all  subjects  who  conformed  to  the  affirmation  of  q rule  for 
Question  6 stated  that  the  reverse  hypothesis  would  be  de- 


The  analysis  for  the  relationships  between  the  factors 
in  this  experiment  provides  further  support  for  the  hypoth- 
esis stated  earlier  in  this  section.  Subjects  appear  to  be 
able  to  answer  questions  consistently  based  on  both  formal 
operational  abilities  and  propositional  logic.  However,  in 
the  bending  rods  problem,  the  two  types  of  questions  were  not 
related  to  a great  extent,  and  the  relationship  between  the 
two  types  of  questions  in  the  pendulum  problem  is  due  to  the 

swerod  consistently  in  terms  of  propositional  logic  rules, 
but  the  interpretation  of  results  for  the  more  complex  ques- 
tions fell  into  several  different  categories.  In  addition, 
the  propositional  rules  that  subjects  conformed  to  were  usu- 
ally the  simplest  interpretation  of  the  results. 


CHAPTER  7 

GENERAL  DISCUSSION  AND  CONCLUSIONS 

The  results  of  Experiment  1 revealed  no  relationship 
between  performance  on  pencil-and-paper  versions  of  tradi- 
tional Piagetian  tasks  and  on  the  THOG  problem  and  selection 
task.  This  result  was  interpreted  as  an  indication  that  dif- 
ferent abilities  may  underlie  performance  on  the  two  types 
of  tasks.  Specifically,  it  was  inferred  that  the  most 
important  ability  for  successful  performance  on  the  Piaget- 
ian tasks  was  the  isolation  and  control  of  variables.  It 
was  inferred  that  successful  performance  on  the  two  logic 
tasks  was  due  to  propositional  logic  ability. 

However,  alternative  interpretations  for  these  results 
are  possible.  For  successful  performance  on  the  selection 
task,  subjects  must  consider  each  card  individually,  form  a 
hypothesis  about  what  could  be  on  the  reverse  side,  and  eval- 
uate the  consequences  of  the  alternatives.  For  successful 
performance  on  the  THOG  task,  subjects  must  postulate  hypoth- 
eses about  what  must  be  written  down  based  on  the  rule  and 
the  instance  of  a THOG,  separate  the  attributes  of  each  de- 
sign from  the  design  itself,  perform  a combinatorial  analy- 
sis on  the  resulting  hypothesized  relevant  attributes,  and 
finally,  form  the  correct  conclusion  based  upon  the 
of  the  preceeding  three 


steps  in  the  problem. 


possible  cause: 


o postulate  possible 
d then  exhaustively  I 
n a controlled  experiment 


the  Piagetian  tasks  was  much  higher  than  that  on  the  proposi- 
tional tasks  in  Experiment  1.  Thus,  although  the  proposi- 

framework  which  makes  the  overall  structure  of  all  of  the 
tasks  very  similar,  this  framework  also  creates  additional 
steps  for  the  solution  of  the  propositional  logic  problems. 
The  differences  in  task  performance,  therefore,  could  be  due 
to  task  differences  rather  than  differences  in  underlying 
ability;  the  propositional  logic  tasks  appear  to  be  more 
difficult. 

The  data  of  Experiment  1 are  not  sufficient  to  separate 
these  two  possible  explanations.  However,  Lawson  et  al. 

(1978)  tested  different  age  groups  utilizing  Piagetian  tasks 
and  a version  of  Wason's  selection  task.  When  a principle- 

the  tasks  did  not  load  according  to  level  of  difficulty  at 
any  grade  level.  Lawson  et  al.  (1978)  interpret  this  result 
as  supportive  of  the  hypothesis  that  different  abilities  un- 
derlie performance  on  the  Piagetian  and  propositional  logic 
tasks  rather  than  task  differences. 

However,  a further  difficulty  exists  in  this  interpreta- 
tion of  the  data  of  Experiment  1.  A Piagetian  interpretation 
of  the  results  would  explain  the  performance  differences  in 


they  are  outside  of  the  realm  of  anyone's  experience,  there- 
fore it  is  not  surprising  that  performance  level  is  so  low. 
As  was  discussed  in  Chapter  3,  however,  merely  presenting 
these  propositional  logic  tasks  in  a realistic  framework 
does  not  improve  performance.  Only  if  a specific  memory-cu- 
ing situation  is  utilized  will  a majority  of  subjects  give 
the  correct  answer.  It  is  possible  that  some  transfer  ex- 

D' Andrade,  cited  in  Rumel- 
t distinction  between  the  use 
then,  becomes  blurred.  It 
i paradox  for  either  the  log- 
To  test  the  relationship 


ists  between  a specific  s 
based  rule,  possibly  by  using 
egy  (e.g.,  Cox  & Griggs,  Note 

of  logic  and  the  use  of  memor 

ic  tasks  or  the  Piagetian  tas 
between  a subject's  knowledge  base  and  his  or  her  use  of 
propositional  logic,  the  knowledge  framework  will  have  to  be 
evoked  by  the  problem  without  eliciting  the  specific  solution 
to  the  problem.  One  approach  to  this  strategy  has  been  to 
formulate  the  task  so  that  the  correct  answer  is  contradic- 
tory to  experience  (e.g.,  Newstead  et  al.  Note  2,  Experiment 
4) , and  there  may  be  other  approaches. 

Because  of  these  considerations,  any  conclusions  about 
the  nonsignificant  correlation  between  the  Piagetian  tasks 
and  the  propositional  logic  tasks  given  in  Experiment  1 must 
be  qualified.  However,  it  is  clear  that  successful 


e Piagetian  tasks, 
t separate  abil- 


performance  on  the  propositional  logic  t 

and  Lawson  et  al.  (1978)  present  evidence  t 
ities  underlie  the  two  types  of  tasks . 

Almost  every  subject  listed  at  least  some  factors  which  could 
influence  both  presented  situations.  In  addition,  most  sub- 
jects recognized  confounded  variables  and  could  isolate  and 
test  variables  when  asked  to  do  so.  The  greatest  variability 

that  subjects  mentioned.  Again,  this  supports  the  hypothesis 
that  a major  component  of  formal  operational  behavior  is  the 
ability  to  isolate  and  control  variables. 

The  logic  rule  that  was  used  by  the  subject,  however,  was  al- 
ways the  simplest  one  possible.  In  addition,  when  the  pre- 
sented results  were  based  on  a rule  that  was  not  congruent 
with  everyday  experience,  a variety  of  qualitatively  differ- 
ent response  categories  occurred.  Several  categories  repre- 


sented concrete  operational  responses  since  the  answers  were 
more  restricted  (Peel,  1971) . However,  this  situation  oc- 
curred on  only  a few  questions,  and  for  the  most  part  sub- 
jects performed  at  a formal  operational  level.  One  limita- 
tion of  the  questions  utilized  in  Experiment  2 is  that  a 


tional  logic  rules  probably  would  have  differentiated  be- 

A comparison  between  the  performance  levels  of  the  sub- 
jects in  Experiments  1 and  2 reveals  that  subjects  performed 
on  the  average  at  a higher  level  in  Experiment  2.  In  other 
words,  subjects  perform  better  when  the  questions  are  more 
specific,  when  they  are  given  a chance  to  recognise  the  con- 
founding of  factors,  and  when  they  are  asked  specific  ques- 

Also,  subjects  do  conform  to  propositional  logic  if  a ques- 
tion poses  a problem  in  such  a way  that  this  conformity  can 
be  easily  measured.  Thus,  it  is  possible  to  conclude  that 
most  people  in  this  age  range  do  perform  at  the  formal  oper- 
ational level,  and  in  accordance  with  propositional  logic, 
but  that  this  ability  is  not  elicited  by  the  typical  formal 
operational  task. 

question  of  how  formal  operations  should  be  defined.  To  de- 
fine formal  operations  as  the  ability  to  recognize  certain 
erroneous  aspects  of  data  or  the  ability  to  answer  specific 

not  be  as  valid  as  a definition  employing  the  idea  of  the 
spontaneous  use  of  this  knowledge.  This  argument  is  similar 

of  assessing  formal  operations  by  mere  permutational  ability. 


s by  Piaget  to  assume  that  a truly  formal  operational 
person  will  interpret  reality  in  terms  of  an  overriding 
framework  congruent  with  formal  operations , and  thus  will  be 
able  to  express  this  ability  in  many  appropriate  situations. 

This  framework  hypothesis  can  be  conceptualised  without 

propositional  operations.  In  several  studies,  Lawson  and 
his  colleagues  and  others  have  demonstrated  that  the  abil- 
ities typically  associated  with  formal  operations,  such  as 
correlations,  probability,  proportional  reasoning,  combina- 
torial analyses,  and  the  isolation  and  control  of  variables 
develop  during  adolescence  (e.g.,  Kuhn  & Brannock,  1977;  Law- 
son  et  al.,  1978;  Lawson  & Nordland , 1976;  Lawson  & Renner, 
1974) . Lawson  et  al.  (1978)  conclude  that  the  advances  in 
hypothetico-deductive  reasoning  are  the  result  of  these  de- 
veloping "schemes,"  and  that  propositional  logic  plays  es- 
sentially no  role  in  this  process. 

This  conclusion  postulating  the  relevance  of  these 

f the  results  in  past  research 


schemes  can  account  for  most  o 
on  formal  operations.  In  fact 
attempted  to  link  the  results  ■ 
binary  operations,  but  rather  : 

suggests  that  this  connection 


researchers  have  not  usually 
if  their  experiments  to  the  16 
lave  usually  related  their 
formal  operational  abilities, 
of  Lawson  and  his  colleagues, 
.s  probably  not  necessary. 


APPENDIX  A 

THE  FOUR  CARD  PROBLEM  AND  JUSTIFICATION 
SHEET  USED  IN  EXPERIMENT  1 
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you  have  indicated  your  answers,  would  you  please. 


in.  If  while  writing  your  reasons  you  decide  that 


Reasons  you 
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indicated  your  answers,  would  you  please 
for  the  responses  you  chose?  Please  write 
tf,  why  you  categorized  each  design  in  the 


Please  note  that  you  MUST  NOT  CHANGE  the  answers  you  have  al 
ready  given.  If  while  writing  your reasons,  you  decide  that 


Reasons  for  choice  of  classification 


black  circle 


white  circle 


APPENDIX  C 

THE  PROBLEM  BOOKLET  USED  IN 
EXPERIMENT  1 


Please  list  t 


College  Lab? 


Chemistry 

High  School  Lab?  College  Lab? 


High  School  Lab?  College  Lab? 


High Sc 


You  will  be  asked  to  solve  three  problems  in  this  part  of  the 
experiment.  I am  not  asking  you  to  demonstrate  your  knowl- 
edge about  the  answers  to  the  problems.  Rather,  I am  inter- 
ested in  your  method  of  solving  the  problems.  Therefore, 
whether  or  not  you  already  know  the  answer  from  your  past  ex- 
perience, it  is  very  important  that  you  explain  the  method 
for  finding  the  answer  carefully  and  completely.  When  you 
answer  the  question,  you  can  assume  that  you  have  unlimited 
materials  of  any  type.  It  is  also  important  that  you  write 
clearly  so  that  I can  read  your  answers! 


APPENDIX  D 

THE  PERMUTATION  PROBLEM  PRESENTED  IN  EXPERIMENT  1 


APPENDIX  E 

THE  INFORMATION  SHEET  AND  TOO  PROBLEMS 
USED  IN  EXPERIMENT  2 
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aIn  the  experiment,  only  two  questions  were  on  each  page. 
For  reasons  of  brevity,  more  than  two  questions  per  page 
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Suppose  that  you  wanted  to  test  the  hypothesis  that 
long  bars  bend  if  and  only  if  they  are  brass.  IE  this 
statement  is  true,  what  result  or  results  in  the  exper- 
iment must  exist?  (Which  bar  or  bars  must  bend?) 

Which  result  or  results  would  disprove  the  hypothesis 
if  they  did  exist?  (Which  bar  or  bars  must  not  bend?) 
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